Vehicle operation assistance information management for autonomous vehicle control operation

ABSTRACT

A vehicle implementing vehicle operation assistance information management for autonomous vehicle control operation may identify a vehicle operation assistance information item, the vehicle operation assistance information item indicating a location of a candidate vehicle control operation. On a condition that the immanency is within the maximum relevant immanence, the vehicle may present a representation of the vehicle operation assistance information item, which may include controlling the primary graphical display portion to present a graphical representation of the vehicle operation assistance information item, wherein controlling the primary graphical display portion to present the graphical representation includes controlling the primary graphical display portion to present a first portion of the graphical representation, and controlling the secondary graphical display portion to present the graphical representation, wherein controlling the secondary graphical display portion to present the graphical representation includes controlling the secondary graphical display portion to present a second portion of the graphical representation.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation-in-part of U.S. patent applicationSer. No. 14/749,373, filed on Jun. 24, 2015, the entire content of whichis incorporated herein by reference.

TECHNICAL FIELD

This disclosure relates to generating and presenting vehicle operationassistance information, vehicle navigation, and vehicle routing.

BACKGROUND

A vehicle may traverse a portion of a vehicle transportation network,which may include traversing a portion of the vehicle transportationnetwork in response to driver control, autonomous vehicle control, or acombination thereof. Accordingly, a method and apparatus for vehicleoperation assistance information management for autonomous vehiclecontrol operation may be advantageous.

SUMMARY

Disclosed herein are aspects, features, elements, implementations, andembodiments of vehicle operation assistance information management forautonomous vehicle control operation.

An aspect of the disclosed embodiments is a vehicle configured toperform vehicle operation assistance information management forautonomous vehicle control transfer. The vehicle may include a primarygraphical display portion, a secondary graphical display portion, and aprocessor configured to execute instructions stored on a non-transitorycomputer readable medium to perform vehicle operation assistanceinformation management autonomous vehicle control operation. Vehicleoperation assistance information management autonomous vehicle controloperation may include identifying a vehicle operation assistanceinformation item, the vehicle operation assistance information itemindicating a location of a candidate vehicle control operation. Vehicleoperation assistance information management autonomous vehicle controloperation may include, on a condition that an immanency for the vehicleoperation assistance information item exceeds a maximum relevantimmanence, storing information representing the vehicle operationassistance information item. Vehicle operation assistance informationmanagement autonomous vehicle control operation may include, on acondition that the immanency is within the maximum relevant immanence,presenting a representation of the vehicle operation assistanceinformation item. Presenting the representation of the vehicle operationassistance information item may include controlling the primarygraphical display portion to present a graphical representation of thevehicle operation assistance information item, wherein controlling theprimary graphical display portion to present the graphicalrepresentation includes controlling the primary graphical displayportion to present a first portion of the graphical representation, andcontrolling the secondary graphical display portion to present thegraphical representation, wherein controlling the secondary graphicaldisplay portion to present the graphical representation includescontrolling the secondary graphical display portion to present a secondportion of the graphical representation.

Another aspect of the disclosed embodiments is a vehicle configured toperform vehicle operation assistance information management forautonomous vehicle control operation. The vehicle may include a primarygraphical display portion, a secondary graphical display portion, and aprocessor configured to execute instructions stored on a non-transitorycomputer readable medium to perform vehicle operation assistanceinformation management autonomous vehicle control operation. Vehicleoperation assistance information management autonomous vehicle controloperation may include identifying a vehicle operation assistanceinformation item, the vehicle operation assistance information itemindicating a location of a candidate vehicle control operation, andpresenting a representation of the vehicle operation assistanceinformation item. Presenting the representation of the vehicle operationassistance information item may include controlling the primarygraphical display portion to present a graphical representation of thevehicle operation assistance information item, wherein controlling theprimary graphical display portion to present the graphicalrepresentation includes controlling the primary graphical displayportion to present a first portion of the graphical representation, andcontrolling the secondary graphical display portion to present thegraphical representation, wherein controlling the secondary graphicaldisplay portion to present the graphical representation includescontrolling the secondary graphical display portion to present a secondportion of the graphical representation. Vehicle operation assistanceinformation management autonomous vehicle control operation may includedetermining whether the candidate vehicle control operation is anapproved vehicle control operation, in response to a determination thatthe candidate vehicle control operation is an unapproved vehicle controloperation, identifying a secondary vehicle control action, andcontrolling the vehicle to traverse the vehicle transportation networkin accordance with the secondary vehicle control action, whereincontrolling the vehicle to traverse the vehicle transportation networkin accordance with the secondary vehicle control action includesomitting the candidate vehicle control operation. Vehicle operationassistance information management autonomous vehicle control operationmay include, in response to a determination that the candidate vehiclecontrol operation is an approved vehicle control operation, controllingthe vehicle to traverse the vehicle transportation network in accordancewith the candidate vehicle control operation.

Another aspect of the disclosed embodiments is a vehicle configured toperform vehicle operation assistance information management forautonomous vehicle control operation. The vehicle may include a primarygraphical display portion, a secondary graphical display portion, atrajectory controller, and a processor configured to executeinstructions stored on a non-transitory computer readable medium toperform vehicle operation assistance information management autonomousvehicle control operation. Vehicle operation assistance informationmanagement autonomous vehicle control operation may include identifyinga vehicle operation assistance information item, the vehicle operationassistance information item indicating a location of a candidate vehiclecontrol operation. Vehicle operation assistance information managementautonomous vehicle control operation may include presenting arepresentation of the vehicle operation assistance information item.Presenting the representation of the vehicle operation assistanceinformation item may include controlling the primary graphical displayportion to present a graphical representation of the vehicle operationassistance information item, and controlling the secondary graphicaldisplay portion to present the graphical representation. Vehicleoperation assistance information management autonomous vehicle controloperation may include determining whether the candidate vehicle controloperation is an approved vehicle control operation, and in response to adetermination that the candidate vehicle control operation is anapproved vehicle control operation, identifying the candidate vehiclecontrol action as a vehicle control action. Vehicle operation assistanceinformation management autonomous vehicle control operation may include,in response to a determination that the candidate vehicle controloperation is an unapproved vehicle control operation, identifying asecondary vehicle control action as the vehicle control action, andcontrolling the trajectory controller to operate the vehicle toautonomously traverse the vehicle transportation network in accordancewith the vehicle control action.

Variations in these and other aspects, features, elements,implementations, and embodiments of the methods, apparatus, procedures,and algorithms disclosed herein are described in further detailhereafter.

BRIEF DESCRIPTION OF THE DRAWINGS

The various aspects of the methods and apparatuses disclosed herein willbecome more apparent by referring to the examples provided in thefollowing description and drawings in which:

FIG. 1 is a diagram of an example of a vehicle in which the aspects,features, and elements disclosed herein may be implemented;

FIG. 2 is a diagram of an example of a portion of a vehicletransportation and communication system in which the aspects, features,and elements disclosed herein may be implemented;

FIG. 3 is a diagram of vehicles operating in a portion of a vehicletransportation network in accordance with this disclosure;

FIG. 4 is a diagram of vehicle operation assistance informationmanagement in accordance with this disclosure;

FIG. 5 is a diagram of determining an immanency in accordance with thisdisclosure;

FIG. 6 is a diagram of determining urgency in accordance with thisdisclosure;

FIG. 7 is a diagram of determining a utility metric in accordance withthis disclosure;

FIG. 8 is a diagram of determining a vehicle operation risk metric inaccordance with this disclosure;

FIG. 9 is a diagram of determining a frequency metric in accordance withthis disclosure;

FIG. 10 is a diagram of presenting a representation of vehicle operationassistance information in accordance with this disclosure;

FIG. 11 is a diagram of presenting a graphical representation of thevehicle operation assistance information via a primary graphical displayportion in accordance with this disclosure;

FIG. 12 is a diagram of presenting a graphical representation of thevehicle operation assistance information via a secondary graphicaldisplay portion in accordance with this disclosure;

FIG. 13 is a diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure;

FIG. 14 is another diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure;

FIG. 15 is another diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure;

FIG. 16 is a diagram of positioning vehicle operation assistanceinformation graphical presentations within a vehicle in accordance withthis disclosure;

FIG. 17 shows examples of a graphical representation of vehicleoperation assistance information in accordance with this disclosure;

FIG. 18 is a diagram of vehicle operation assistance informationmanagement for autonomous vehicle control operation in accordance withthis disclosure;

FIG. 19 is a diagram of determining an immanency for autonomous vehiclecontrol operation in accordance with this disclosure;

FIG. 20 is a diagram of determining urgency for autonomous vehiclecontrol operation in accordance with this disclosure;

FIG. 21 is a diagram of utilizing vehicle operation assistanceinformation in accordance with this disclosure;

FIG. 22 shows examples of graphical representations of vehicle operationassistance information for autonomous vehicle control transfer inaccordance with this disclosure;

FIG. 23 shows an example of a graphical representations of vehicleoperation assistance information for autonomous vehicle control lanechange in accordance with this disclosure;

FIG. 24 shows another example of a graphical representations of vehicleoperation assistance information for autonomous vehicle control lanechange in accordance with this disclosure;

FIG. 25 shows an example of a graphical representations of vehicleoperation assistance information for an autonomous vehicle control turnoperation in accordance with this disclosure; and

FIG. 26 shows an example of a graphical representations of vehicleoperation assistance information for an autonomous vehicle speed controloperation in accordance with this disclosure.

DETAILED DESCRIPTION

A vehicle, such as an autonomous vehicle, may traverse a portion of avehicle transportation network and may identify vehicle operationassistance information, which may indicate a vehicle operation orvehicle transportation network condition that may affect the safe andefficient operation of the vehicle to traverse the vehicletransportation network.

In some embodiments, vehicle operation assistance information managementfor autonomous vehicle control operation may include presentinginformation representing the vehicle operation assistance informationvia one or more of a primary graphical display portion in the vehicle, asecondary graphical display portion in the vehicle, or an auditorypresentation device in the vehicle. The primary graphical displayportion, and the information displayed thereon, may be configured toprovide an easily recognizable, minimally distracting representation ofthe vehicle operation assistance information. The secondary graphicaldisplay portion, and the information displayed thereon, may beconfigured to provide a more detailed description of the informationindicated by the primary graphical display portion.

In some embodiments, vehicle operation assistance information mayinclude information indicating a vehicle operation control transfer oran autonomous vehicle operation, and vehicle operation assistanceinformation management for autonomous vehicle control operation mayinclude presenting the information representing the vehicle operationassistance information as advance information, which may correspond withvehicle operation assistance information that is relevant to the futureoperation of the vehicle, and which may be presented via the secondarygraphical display portion, as advisory information, which may correspondwith vehicle operation assistance information that is relevant to thecurrent, comfortable, operation of the vehicle, and which may bepresented via the primary graphical display portion and, subsequently,via the secondary graphical display portion, or as warning information,which may correspond with vehicle operation assistance information thatis relevant to the current urgent or emergent operation of the vehicle,and which may be presented via the primary graphical display portionand, subsequently, via the secondary graphical display portion. In someembodiments, vehicle operation assistance information management forautonomous vehicle control operation may include operating the vehiclein accordance with vehicle operation assistance information.

The simplified overview above is provided to help enable a basic orgeneral understanding of various aspects of exemplary, non-limiting,embodiments that follow in the more detailed description and theaccompanying drawings, and is not a complete or exhaustive descriptionof any particular element of this disclosure.

FIG. 1 is a diagram of an example of a vehicle in which the aspects,features, and elements disclosed herein may be implemented. In someembodiments, a vehicle 1000 may include a chassis 1100, a powertrain1200, a controller 1300, wheels 1400, or any other element orcombination of elements of a vehicle. Although the vehicle 1000 is shownas including four wheels 1400 for simplicity, any other propulsiondevice or devices, such as a propeller or tread, may be used. In FIG. 1,the lines interconnecting elements, such as the powertrain 1200, thecontroller 1300, and the wheels 1400, indicate that information, such asdata or control signals, power, such as electrical power or torque, orboth information and power, may be communicated between the respectiveelements. For example, the controller 1300 may receive power from thepowertrain 1200 and may communicate with the powertrain 1200, the wheels1400, or both, to control the vehicle 1000, which may includeaccelerating, decelerating, steering, or otherwise controlling thevehicle 1000.

The powertrain 1200 may include a power source 1210, a transmission1220, a steering unit 1230, an actuator 1240, or any other element orcombination of elements of a powertrain, such as a suspension, a driveshaft, axles, or an exhaust system. Although shown separately, thewheels 1400 may be included in the powertrain 1200.

The power source 1210 may include an engine, a battery, or a combinationthereof. The power source 1210 may be any device or combination ofdevices operative to provide energy, such as electrical energy, thermalenergy, or kinetic energy. For example, the power source 1210 mayinclude an engine, such as an internal combustion engine, an electricmotor, or a combination of an internal combustion engine and an electricmotor, and may be operative to provide kinetic energy as a motive forceto one or more of the wheels 1400. In some embodiments, the power source1400 may include a potential energy unit, such as one or more dry cellbatteries, such as nickel-cadmium (NiCd), nickel-zinc (NiZn), nickelmetal hydride (NiMH), lithium-ion (Li-ion); solar cells; fuel cells; orany other device capable of providing energy.

The transmission 1220 may receive energy, such as kinetic energy, fromthe power source 1210, and may transmit the energy to the wheels 1400 toprovide a motive force. The transmission 1220 may be controlled by thecontrol unit 1300 the actuator 1240 or both. The steering unit 1230 maybe controlled by the control unit 1300 the actuator 1240 or both and maycontrol the wheels 1400 to steer the vehicle. The vehicle actuator 1240may receive signals from the controller 1300 and may actuate or controlthe power source 1210, the transmission 1220, the steering unit 1230, orany combination thereof to operate the vehicle 1000.

In some embodiments, the controller 1300 may include a location unit1310, an electronic communication unit 1320, a processor 1330, a memory1340, a user interface 1350, a sensor 1360, an electronic communicationinterface 1370, or any combination thereof. Although shown as a singleunit, any one or more elements of the controller 1300 may be integratedinto any number of separate physical units. For example, the userinterface 1350 and processor 1330 may be integrated in a first physicalunit and the memory 1340 may be integrated in a second physical unit.Although not shown in FIG. 1, the controller 1300 may include a powersource, such as a battery. Although shown as separate elements, thelocation unit 1310, the electronic communication unit 1320, theprocessor 1330, the memory 1340, the user interface 1350, the sensor1360, the electronic communication interface 1370, or any combinationthereof may be integrated in one or more electronic units, circuits, orchips.

In some embodiments, the processor 1330 may include any device orcombination of devices capable of manipulating or processing a signal orother information now-existing or hereafter developed, including opticalprocessors, quantum processors, molecular processors, or a combinationthereof. For example, the processor 1330 may include one or more specialpurpose processors, one or more digital signal processors, one or moremicroprocessors, one or more controllers, one or more microcontrollers,one or more integrated circuits, one or more an Application SpecificIntegrated Circuits, one or more Field Programmable Gate Array, one ormore programmable logic arrays, one or more programmable logiccontrollers, one or more state machines, or any combination thereof. Theprocessor 1330 may be operatively coupled with the location unit 1310,the memory 1340, the electronic communication interface 1370, theelectronic communication unit 1320, the user interface 1350, the sensor1360, the powertrain 1200, or any combination thereof. For example, theprocessor may be operatively coupled with the memory 1340 via acommunication bus 1380.

The memory 1340 may include any tangible non-transitory computer-usableor computer-readable medium, capable of, for example, containing,storing, communicating, or transporting machine readable instructions,or any information associated therewith, for use by or in connectionwith the processor 1330. The memory 1340 may be, for example, one ormore solid state drives, one or more memory cards, one or more removablemedia, one or more read only memories, one or more random accessmemories, one or more disks, including a hard disk, a floppy disk, anoptical disk, a magnetic or optical card, or any type of non-transitorymedia suitable for storing electronic information, or any combinationthereof.

The communication interface 1370 may be a wireless antenna, as shown, awired communication port, an optical communication port, or any otherwired or wireless unit capable of interfacing with a wired or wirelesselectronic communication medium 1500. Although FIG. 1 shows thecommunication interface 1370 communicating via a single communicationlink, a communication interface may be configured to communicate viamultiple communication links. Although FIG. 1 shows a singlecommunication interface 1370, a vehicle may include any number ofcommunication interfaces.

The communication unit 1320 may be configured to transmit or receivesignals via a wired or wireless medium 1500, such as via thecommunication interface 1370. Although not explicitly shown in FIG. 1,the communication unit 1320 may be configured to transmit, receive, orboth via any wired or wireless communication medium, such as radiofrequency (RF), ultra violet (UV), visible light, fiber optic, wireline, or a combination thereof. Although FIG. 1 shows a singlecommunication unit 1320 and a single communication interface 1370, anynumber of communication units and any number of communication interfacesmay be used. In some embodiments, the communication unit 1320 mayinclude a dedicated short range communications (DSRC) unit, a wirelesssafety unit (WSU), or a combination thereof.

The location unit 1310 may determine geolocation information, such aslongitude, latitude, elevation, direction of travel, or speed, of thevehicle 1000. For example, the location unit may include a globalpositioning system (GPS) unit, such as a Wide Area Augmentation System(WAAS) enabled National Marine-Electronics Association (NMEA) unit, aradio triangulation unit, or a combination thereof. The location unit1310 can be used to obtain information that represents, for example, acurrent heading of the vehicle 1000, a current position of the vehicle1000 in two or three dimensions, a current angular orientation of thevehicle 1000, or a combination thereof.

The user interface 1350 may include any unit capable of interfacing witha person, such as a virtual or physical keypad, a touchpad, a display, atouch display, a heads-up display, a virtual display, an augmentedreality display, a speaker, a microphone, a haptic display, a featuretracking device, such as an eye-tracking device, a video camera, asensor, a printer, or any combination thereof. The user interface 1350may be operatively coupled with the processor 1330, as shown, or withany other element of the controller 1300. Although shown as a singleunit, the user interface 1350 may include one or more physical units.For example, the user interface 1350 may include an audio interface forperforming audio communication with a person, and a touch display forperforming visual and touch based communication with the person. In someembodiments, the user interface 1350 may include multiple displays, suchas multiple physically separate units, multiple defined portions withina single physical unit, or a combination thereof.

The sensor 1360 may include one or more sensors, such as an array ofsensors, which may be operable to provide information that may be usedto control the vehicle. The sensors 1360 may provide informationregarding current operating characteristics of the vehicle. The sensors1360 can include, for example, a speed sensor, acceleration sensors, asteering angle sensor, traction-related sensors, braking-relatedsensors, steering wheel position sensors, eye tracking sensors, seatingposition sensors, or any sensor, or combination of sensors, that isoperable to report information regarding some aspect of the currentdynamic situation of the vehicle 1000.

In some embodiments, the sensors 1360 may include sensors that areoperable to obtain information regarding the physical environmentsurrounding the vehicle 1000. For example, one or more sensors maydetect road geometry and obstacles, such as fixed obstacles, vehicles,and pedestrians. In some embodiments, the sensors 1360 can be or includeone or more video cameras, laser-sensing systems, infrared-sensingsystems, acoustic-sensing systems, or any other suitable type ofon-vehicle environmental sensing device, or combination of devices, nowknown or later developed. In some embodiments, the sensors 1360 and thelocation unit 1310 may be combined.

Although not shown separately, in some embodiments, the vehicle 1000 mayinclude a trajectory controller. For example, the controller 1300 mayinclude the trajectory controller. The trajectory controller may beoperable to obtain information describing a current state of the vehicle1000 and a rout planned for the vehicle 1000, and, based on thisinformation, to determine and optimize a trajectory for the vehicle1000. In some embodiments, the trajectory controller may output signalsoperable to control the vehicle 1000 such that the vehicle 1000 followsthe trajectory that is determined by the trajectory controller. Forexample, the output of the trajectory controller can be an optimizedtrajectory that may be supplied to the powertrain 1200, the wheels 1400,or both. In some embodiments, the optimized trajectory can be controlinputs such as a set of steering angles, with each steering anglecorresponding to a point in time or a position. In some embodiments, theoptimized trajectory can be one or more paths, lines, curves, or acombination thereof.

One or more of the wheels 1400 may be a steered wheel, which may bepivoted to a steering angle under control of the steering unit 1230, apropelled wheel, which may be torqued to propel the vehicle 1000 undercontrol of the transmission 1220, or a steered and propelled wheel thatmay steer and propel the vehicle 1000.

Although not shown in FIG. 1, a vehicle may include units, or elementsnot shown in FIG. 1, such as an enclosure, a Bluetooth® module, afrequency modulated (FM) radio unit, a Near Field Communication (NFC)module, a liquid crystal display (LCD) display unit, an organiclight-emitting diode (OLED) display unit, a speaker, or any combinationthereof.

In some embodiments, the vehicle may be an autonomous vehicle. Anautonomous vehicle may be controlled autonomously, without direct humanintervention, to traverse a portion of a vehicle transportation network.Although not shown separately in FIG. 1, in some implementations, anautonomous vehicle may include an autonomous vehicle control unit, whichmay perform autonomous vehicle routing, navigation, and control. In someimplementations, the autonomous vehicle control unit may be integratedwith another unit of the vehicle. For example, the controller 1300 mayinclude the autonomous vehicle control unit.

In some implementations, the autonomous vehicle control unit may controlor operate the vehicle to traverse a portion of the vehicletransportation network in accordance with current vehicle operationparameters. In another example, the autonomous vehicle control unit maycontrol or operate the vehicle to perform a defined operation ormaneuver, such as parking the vehicle. In another example, autonomousvehicle control unit may generate a route of travel from an origin, suchas a current location of the vehicle, to a destination based on vehicleinformation, environment information, vehicle transportation networkinformation representing the vehicle transportation network, or acombination thereof, and may control or operate the vehicle to traversethe vehicle transportation network in accordance with the route. Forexample, the autonomous vehicle control unit may output the route oftravel to a trajectory controller that may operate the vehicle to travelfrom the origin to the destination using the generated route.

FIG. 2 is a diagram of an example of a portion of a vehicletransportation and communication system in which the aspects, features,and elements disclosed herein may be implemented. The vehicletransportation and communication system 2000 may include one or morevehicles 2100/2110, such as the vehicle 1000 shown in FIG. 1, which maytravel via one or more portions of one or more vehicle transportationnetworks 2200, and may communicate via one or more electroniccommunication networks 2300. Although not explicitly shown in FIG. 2, avehicle may traverse an area that is not expressly or completelyincluded in a vehicle transportation network, such as an off-road area.

In some embodiments, the electronic communication network 2300 may be,for example, a multiple access system and may provide for communication,such as voice communication, data communication, video communication,messaging communication, or a combination thereof, between the vehicle2100/2110 and one or more communication devices 2400. For example, avehicle 2100/2110 may receive information, such as informationrepresenting the vehicle transportation network 2200, from acommunication device 2400 via the network 2300.

In some embodiments, a vehicle 2100/2110 may communicate via a wiredcommunication link (not shown), a wireless communication link2310/2320/2370, or a combination of any number of wired or wirelesscommunication links. For example, as shown, a vehicle 2100/2110 maycommunicate via a terrestrial wireless communication link 2310, via anon-terrestrial wireless communication link 2320, or via a combinationthereof. In some implementations, a terrestrial wireless communicationlink 2310 may include an Ethernet link, a serial link, a Bluetooth link,an infrared (IR) link, an ultraviolet (UV) link, or any link capable ofproviding for electronic communication.

In some embodiments, a vehicle 2100/2110 may communicate with anothervehicle 2100/2110. For example, a host, or subject, vehicle (HV) 2100may receive one or more automated inter-vehicle messages, such as abasic safety message, from a remote, or target, vehicle (RV) 2110, via adirect communication link 2370, or via a network 2300. For example, theremote vehicle 2110 may broadcast the message to host vehicles within adefined broadcast range, such as 300 meters. In some embodiments, thehost vehicle 2100 may receive a message via a third party, such as asignal repeater (not shown) or another remote vehicle (not shown). Insome embodiments, a vehicle 2100/2110 may transmit one or more automatedinter-vehicle messages periodically, such as based on a definedinterval, such as 100 milliseconds.

Automated inter-vehicle messages may include vehicle identificationinformation, geospatial state information, such as longitude, latitude,or elevation information, geospatial location accuracy information,kinematic state information, such as vehicle acceleration information,yaw rate information, speed information, vehicle heading information,braking system status information, throttle information, steering wheelangle information, or vehicle routing information, or vehicle operatingstate information, such as vehicle size information, headlight stateinformation, turn signal information, wiper status information,transmission information, or any other information, or combination ofinformation, relevant to the transmitting vehicle state. For example,transmission state information may indicate whether the transmittingvehicle is in a neutral state, a parked state, a forward state, or areverse state.

In some embodiments, the vehicle 2100 may communicate with thecommunications network 2300 via an access point 2330. An access point2330, which may include a computing device, may be configured tocommunicate with a vehicle 2100, with a communication network 2300, withone or more communication devices 2400, or with a combination thereofvia wired or wireless communication links 2310/2340. For example, anaccess point 2330 may be a base station, a base transceiver station(BTS), a Node-B, an enhanced Node-B (eNode-B), a Home Node-B (HNode-B),a wireless router, a wired router, a hub, a relay, a switch, or anysimilar wired or wireless device. Although shown as a single unit, anaccess point may include any number of interconnected elements.

In some embodiments, the vehicle 2100 may communicate with thecommunications network 2300 via a satellite 2350, or othernon-terrestrial communication device. A satellite 2350, which mayinclude a computing device, may be configured to communicate with avehicle 2100, with a communication network 2300, with one or morecommunication devices 2400, or with a combination thereof via one ormore communication links 2320/2360. Although shown as a single unit, asatellite may include any number of interconnected elements.

An electronic communication network 2300 may be any type of networkconfigured to provide for voice, data, or any other type of electroniccommunication. For example, the electronic communication network 2300may include a local area network (LAN), a wide area network (WAN), avirtual private network (VPN), a mobile or cellular telephone network,the Internet, or any other electronic communication system. Theelectronic communication network 2300 may use a communication protocol,such as the transmission control protocol (TCP), the user datagramprotocol (UDP), the internet protocol (IP), the real-time transportprotocol (RTP) the Hyper Text Transport Protocol (HTTP), or acombination thereof. Although shown as a single unit, an electroniccommunication network may include any number of interconnected elements.

In some embodiments, a vehicle 2100 may identify a portion or conditionof the vehicle transportation network 2200. For example, the vehicle mayinclude one or more on-vehicle sensors 2105, such as sensor 1360 shownin FIG. 1, which may include a speed sensor, a wheel speed sensor, acamera, a gyroscope, an optical sensor, a laser sensor, a radar sensor,a sonic sensor, or any other sensor or device or combination thereofcapable of determining or identifying a portion or condition of thevehicle transportation network 2200.

In some embodiments, a vehicle 2100 may traverse a portion or portionsof one or more vehicle transportation networks 2200 using informationcommunicated via the network 2300, such as information representing thevehicle transportation network 2200, information identified by one ormore on-vehicle sensors 2105, or a combination thereof.

Although, for simplicity, FIG. 2 shows one vehicle 2100, one vehicletransportation network 2200, one electronic communication network 2300,and one communication device 2400, any number of vehicles, networks, orcomputing devices may be used. In some embodiments, the vehicletransportation and communication system 2000 may include devices, units,or elements not shown in FIG. 2. Although the vehicle 2100 is shown as asingle unit, a vehicle may include any number of interconnectedelements.

Although the vehicle 2100 is shown communicating with the communicationdevice 2400 via the network 2300, the vehicle 2100 may communicate withthe communication device 2400 via any number of direct or indirectcommunication links. For example, the vehicle 2100 may communicate withthe communication device 2400 via a direct communication link, such as aBluetooth communication link.

In some embodiments, vehicle operation assistance information managementmay be implemented in a vehicle, such as the vehicle 1000 shown in FIG.1 or the vehicles 2100/2110 shown in FIG. 2, and may include traversinga vehicle transportation network, or a portion thereof, as shown in FIG.3. In some embodiments, vehicle operation assistance informationmanagement may include receiving, detecting, determining, or identifyingvehicle operation assistance information, such as advanced driverassistance system information. The vehicle operation assistanceinformation may indicate a portion of the vehicle transportation networkand may include information relevant to operating the vehicle withinrecommended or prescribed operating parameters, the vehicle to traversethe vehicle transportation network relative to the indicated portion ofthe vehicle transportation network.

In some embodiments, the portion of the vehicle transportation networkindicated by the vehicle operation assistance information may include aparticular geospatial location, such as a location indicated by GPScoordinates, a geospatial location of a vehicle transportation networkfeature, such as an off ramp or a winding road, a geospatial location ofan area including multiple features of the vehicle transportationnetwork, or a geospatial location relative to the vehicle, such as alocation immediately in front of the vehicle or a lane adjacent to thevehicle.

In some embodiments, the information relevant to operating the vehicleto traverse the vehicle transportation network relative to the indicatedportion of the vehicle transportation network may indicate a conditionor event affecting or potentially affecting the vehicle transportationnetwork, the vehicle, or both, such as a high wind condition, an icyroad surface condition, a reduced speed zone, a disabled vehicle in theroadway, a flat tire, or a substantial likelihood of an impendingcollision or traffic control violation.

In some embodiments, vehicle operation assistance information managementmay include evaluating the vehicle operation assistance information,current vehicle operational parameters, or both. For example, vehicleoperation assistance information management may include determining animmanency, an urgency, a utility, or a combination thereof, based on thevehicle operation assistance information, the current vehicleoperational parameters, or both. In some embodiments, the immanency mayindicate a measure of the proximity of the geographic location indicatedby the vehicle operation assistance information to the vehicle based onthe current vehicle operational parameters. In some embodiments, theurgency may indicate a measure of the proximity of the geographiclocation indicated by the vehicle operation assistance information tothe vehicle based on defined potential future vehicle operations. Insome embodiments, the utility may indicate an expected value ofutilizing the vehicle operation assistance information. In someembodiments, utilizing the vehicle operation assistance information mayinclude presenting information to a driver of the vehicle based on thevehicle operation assistance information, and the utility, or expectedvalue of utilizing the vehicle operation assistance information, may bebased on an expected probability of the driver utilizing the informationpresented to control the vehicle to traverse the vehicle transportationnetwork.

In some embodiments, vehicle operation assistance information managementmay include presenting information to a driver of the vehicle based onthe vehicle operation assistance information may include determining howto present the information representing the vehicle operation assistanceinformation using a primary graphical display portion, a secondarygraphical display portion, an auditory presentation device, or anycombination thereof, to maximize the probability of the driver utilizingthe information presented to control the vehicle to safely traverse thevehicle transportation network. In some embodiments, vehicle operationassistance information management may include storing, maintaining, andmanaging vehicle operation assistance information.

FIG. 3 is a diagram of vehicles operating in a portion of a vehicletransportation network in accordance with this disclosure. As shown inFIG. 3, a portion of a vehicle transportation network may includenavigable areas, such as a road 3000, which may include one or morelanes 3010/3020/3030. Each lane 3010/3020/3030 may have a direction oftravel as shown. A portion of the vehicle transportation network mayinclude partially navigable or non-navigable areas, such as shoulders3040/3050. Vehicles, such as the remote vehicle 3100 or the host vehicle3200, which may be a vehicle, such as the vehicle 1000 shown in FIG. 1or the vehicles 2100/2110 shown in FIG. 2, may traverse the vehicletransportation network. For simplicity and clarity, a current, or host,vehicle 3200 is shown with stippling and a remote vehicle 3100 is shownin white. Although elevation is not expressly shown in FIG. 3, elevationinformation may be used for vehicle operation assistance informationmanagement.

In some embodiments, vehicle operation assistance information managementmay include identifying vehicle operation assistance information, whichmay indicate a vehicle operational condition or a vehicle transportationnetwork condition that may affect the safe and efficient operation ofthe vehicle to traverse the vehicle transportation network. In someembodiments, the vehicle operation assistance information may indicate ageospatial location within the vehicle transportation network, asindicated by the white diamond at 3300.

A distance between the current location of the vehicle 3200 and thelocation 3300 indicated by the vehicle operation assistance informationmay be identified as the immanency. Although the immanency is shownspatially in FIG. 3, the immanency may indicate a temporal distance, orcost, for the vehicle 3200 to traverse the vehicle transportationnetwork from the current location of the vehicle 3200 to the location3300 indicated by the vehicle operation assistance information based oncurrent vehicle operating parameters.

A warning distance, shown in FIG. 3 as a spatial distance from thelocation 3300 indicated by the vehicle operation assistance information,may indicate a spatial or temporal distance for the vehicle to traversethe vehicle transportation network in accordance with a vehicle controlaction responsive to the vehicle operation assistance information and awarning acceptability metric, such as a vehicle control actionindicating an instruction to stop and a warning acceptability metricindicating a critical or emergent execution of the vehicle controlaction. For example, the vehicle control action may include aninstruction to stop, the warning acceptability metric may indicate thatthe stopping should be performed as quickly as practicable, and thewarning distance may indicate a minimal distance for the vehicle to cometo a stop before reaching the location indicated by the vehicleoperation assistance information at a maximum rate of deceleration.

An advisory distance, shown in FIG. 3 as a spatial distance from theedge of the warning distance proximal to the vehicle, may indicate aspatial or temporal distance for the vehicle to traverse the vehicletransportation network in accordance with a vehicle control actionresponsive to the vehicle operation assistance information and anadvisory acceptability metric, such as a vehicle control actionindicating an instruction to stop and an advisory acceptability metricindicating a comfortable or normal execution of the vehicle controlaction. For example, the vehicle control action may include aninstruction to stop, the advisory acceptability metric may indicate thatthe stopping should be performed in a moderate or comfortable manner,and the advisory distance may indicate a minimal distance for thevehicle to come to a stop before reaching the location indicated by thevehicle operation assistance information at a comfortable rate ofdeceleration.

An advance distance, shown in FIG. 3 as a spatial distance from the edgeof the advisory distance proximal to the vehicle, may indicate a spatialor temporal distance for the vehicle to traverse the vehicletransportation network prior to executing the vehicle control actionresponsive to the vehicle operation assistance information. For example,the vehicle control action may include an instruction to stop, and theadvance distance may indicate a maximum distance wherein the vehicleoperation assistance information is relevant.

FIG. 4 is a diagram of vehicle operation assistance informationmanagement in accordance with this disclosure. In some embodiments,vehicle operation assistance information management may be implementedin a vehicle, such as the vehicle 1000 shown in FIG. 1, the vehicles2100/2110 shown in FIG. 2, or the host vehicle 3200 shown in FIG. 3.

In some embodiments, vehicle operation assistance information managementmay include traversing a portion of a vehicle transportation network at4000, identifying a vehicle operation assistance information item at4100, identifying an immanency for the vehicle operation assistanceinformation item at 4200, determining an urgency at 4300; determining autility metric at 4400, utilizing the vehicle operation assistanceinformation item at 4500, traversing another portion of a vehicletransportation network at 4600, storing information representing thevehicle operation assistance information item at 4700, or a combinationthereof. For simplicity and clarity identifying the immanency at 4200,determining the urgency at 4300, determining the utility metric at 4400,and utilizing the vehicle operation assistance information item at 4500may be collectively referred to herein as evaluating, or reevaluating,the vehicle operation assistance information.

In some embodiments, a current, or host, vehicle may traverse a portionof a vehicle transportation network at 4000. For example, a vehicle,such as the host vehicle 3200 shown in FIG. 3, may traverse a portion ofa vehicle transportation network such as the portion shown in FIG. 3.

In some embodiments, vehicle operation assistance information may beidentified at 4100. In some embodiments, identifying the vehicleoperation assistance information at 4100 may include receiving externalvehicle operation assistance information, which may include an externalvehicle operation assistance information item, or a portion thereof, viaan electronic communication link, such as one of the wireless electroniccommunication links 2310/2320/2370 shown in FIG. 2. For example,identifying the vehicle operation assistance information at 4100 mayinclude receiving an external vehicle operation assistance informationitem, which may include an infrastructure message, from an externalinfrastructure device. In another example, identifying the vehicleoperation assistance information at 4100 may include receiving anexternal vehicle operation assistance information item, which mayinclude an inter-vehicle, or remote vehicle, message, from anothervehicle in the vehicle transportation network, such as the remotevehicle 3100 shown in FIG. 3.

In some embodiments, identifying the vehicle operation assistanceinformation at 4100 may include identifying a vehicle operationassistance information item based on vehicle transportation networkinformation representing the portion of the vehicle transportationnetwork being traversed. For example, vehicle operation assistanceinformation management may include identifying vehicle transportationnetwork information representing the portion of the vehicletransportation network being traversed, such as navigation systeminformation or map information, and may identify a vehicle operationassistance information item indicated in the vehicle transportationnetwork information in response to traversing a portion of the vehicletransportation network within a defined geospatial distance of ageospatial location corresponding to the vehicle operation assistanceinformation item.

In some embodiments, the vehicle may include a sensor, such as thesensor 1360 shown in FIG. 1, or the on-vehicle sensors 2105 shown inFIG. 2, and identifying the vehicle operation assistance information at4100 may include identifying vehicle operation assistance informationbased on sensor information. For example, the vehicle operationassistance information may be identified at 4100 based on sensorinformation indicating vehicle-to-vehicle closing information, gapmaintenance information, parking proximity information, optical, such ascamera based, hazard identification information, visibility information,driver attention information, audio sensor information, rain sensorinformation, roadway quality sensor information, or roadway geometryinformation.

In some embodiments, identifying vehicle operation assistanceinformation at 4100 may include determining whether information isvehicle operation assistance information. In some embodiments, a vehicleoperation assistance information item may expressly indicate that thevehicle operation assistance information item includes vehicle operationassistance information. For example, a vehicle operation assistanceinformation item may include an identifier expressly identifying thevehicle operation assistance information item as vehicle operationassistance information, or may have a format defined for vehicleoperation assistance information. In some embodiments, information maybe identified as vehicle operation assistance information based on aninformation source, content, or a combination thereof. In someembodiments, whether information is vehicle operation assistanceinformation may be determined, or candidate vehicle operation assistanceinformation may be confirmed, by searching a data source, such as adatabase or look-up table, for similar information.

In some embodiments, vehicle operation assistance information may becategorically distinguishable from other types, or categories, ofinformation, such as vehicle operational status information, which mayinclude information such as a current geographic location of thevehicle, a current trajectory of the vehicle, a current speed of thevehicle, vehicle health information, or the like; navigation systeminformation, which may include information such as map information,route information, vehicle transportation network congestioninformation, or the like; vehicle systems management information, whichmay include information such as vehicle configuration information; ornon-operational information, such as entertainment system information.

In some embodiments, identifying vehicle operation assistanceinformation at 4100 may include determining a vehicle operationassistance information type for the vehicle operation assistanceinformation, which may include identifying a vehicle operationassistance information type identifier associated with the vehicleoperation assistance information type.

In some embodiments, an immanency for the vehicle operation assistanceinformation item may be determined at 4200. In some embodiments, theimmanency may indicate temporal cost, which may indicate a temporal orspatial distance, for the vehicle to traverse the vehicle transportationnetwork from a current geospatial location in the vehicle transportationnetwork to a geospatial location indicated by the vehicle operationassistance information. In some embodiments, the vehicle operationassistance information may indicate a portion of the vehicletransportation network and the geospatial location indicated by thevehicle operation assistance information may correspond with ageospatial location of the portion of the vehicle transportation networkindicated by the vehicle operation assistance information proximal tothe vehicle. In some embodiments, determining an immanency for thevehicle operation assistance information item at 4200 may be similar tothe immanency determination shown in FIG. 5.

In some embodiments, determining the immanency at 4200 may includedetermining whether the immanency exceeds, or is greater than, a maximumrelevant immanence, which may be a defined maximum relevant immanence ora calculated maximum relevant immanence. For example, the maximumrelevant immanence may indicate a temporal period, such as one minute,and determining the immanency at 4200 may include determining whetherthe immanency is greater than one minute. In some embodiments, theimmanency may be greater than the maximum relevant immanence,information representing the vehicle operation assistance informationidentified at 4200 may be stored at 4700, and one or more elements ofvehicle operation assistance information management, such as determiningan urgency at 4300, determining a utility metric at 4400, or utilizingthe vehicle operation assistance information item at 4500, may beomitted.

In some embodiments, an urgency for the vehicle operation assistanceinformation item may be determined at 4300. In some embodiments, theurgency may represent a measure of the temporal or spatial distanceavailable for utilizing the vehicle operation assistance information totraverse the vehicle transportation network. For example, vehicleoperation assistance information may indicate a roadway condition, suchas an icy road or a reduced speed zone, an event, such as a disabledvehicle, or a probable event, such as an impending collision, and theurgency may indicate a temporal distance available for utilizing thevehicle operation assistance information to traverse the vehicletransportation network, such as by presenting information to the driverof the vehicle, which may include information representative of thecondition, event, or probable event, and may include instructions foroperating the vehicle, such that the driver of the vehicle may operatethe vehicle in response.

In some embodiments, the urgency may be categorized, or quantized, intoa defined set of urgency types, categories, or bands. For example, awarning urgency may correspond with a high urgency band, an advanceurgency may correspond with a low urgency band, and an advisory urgencymay correspond with an urgency band between the advance urgency and thewarning urgency. Although three urgency bands, advance, advisory, andwarning, are described herein, any number of urgency bands may be used.For example, the advisory band may be replaced with a low advisory band,greater than, or more urgent than, the advance urgency, and a highadvisory band, greater than the low advisory band and less urgent thanthe warning urgency. Although described categorically herein, theurgency may be, or may represent, a numeric, such as integer, value. Insome embodiments, determining an urgency for the vehicle operationassistance information item at 4300 may be similar to the urgencydetermination shown in FIG. 6. For simplicity and clarity, the urgencyassociated with the vehicle operation assistance information identifiedat 4100 may be referred to herein as the current urgency.

In some embodiments, a utility metric for the vehicle operationassistance information item may be determined at 4400. In someembodiments, the utility metric may indicate a value of the vehicleoperation assistance information identified at 4100 relative to currentoperating characteristics for the vehicle. In some embodiments,determining the utility metric for the vehicle operation assistanceinformation item at 4300 may be similar to the utility metricdetermination shown in FIG. 7.

In some embodiments, the utility metric may be identified as indicatinga low utility at 4400, information representing the vehicle operationassistance information identified at 4200 may be stored at 4700, and oneor more elements of vehicle operation assistance information management,such as utilizing the vehicle operation assistance information item at4500, may be omitted.

In some embodiments, the vehicle operation assistance information may beutilized at 4500. For example, utilizing the vehicle operationassistance information at 4500 may include presenting a representationof the vehicle operation assistance information. In some embodiments,presenting a representation of the vehicle operation assistanceinformation may be similar to the presenting shown in FIG. 10.

In some embodiments, the vehicle may traverse another portion of avehicle transportation network at 4600. For example, the vehicle maytraverse the vehicle transportation network at 4600 based on the vehicleoperation assistance information. In some embodiments, traversinganother portion of the vehicle transportation network at 4600 mayinclude storing information representing the vehicle operationassistance information at 4700.

In some embodiments, information representing the vehicle operationassistance information item may be stored at 4700. For example, thevehicle operation assistance information may be stored in a database,look-up table, or any other information store. In some embodiments,storing the vehicle operation assistance information may include storingtemporal information, such as a time and date. In some embodiments,storing the vehicle operation assistance information may include storinggeospatial information, such as the geospatial location indicated by thevehicle operation assistance information. In some embodiments, storingthe vehicle operation assistance information may include storing userinformation, such as an identifier of the driver of the vehicle. In someembodiments, storing the vehicle operation assistance information mayinclude storing vehicle transportation network status information, suchas information indicating whether the vehicle operation assistanceinformation represents a currently active vehicle transportation networkcondition.

In some embodiments, other information may be stored at 4700. Forexample, vehicle operation assistance information presentationcustomization information, such as information identified based ondriver input, may be stored. Vehicle operation assistance informationpresentation customization information may be used to customize thepresentation of vehicle operation assistance information, which mayinclude identifying the primary display portion, the secondary displayportion, or both, and may include identifying one or more parameters forrepresenting the vehicle operation assistance information. In someembodiments, storing information at 4700 may include storing externallyidentified vehicle operation assistance information, which may includetraffic information, such as current or predicted traffic information.In some embodiments, the information stored at 4700 may be transmittedto an external device for storage, analysis, or both. In anotherexample, a vehicle operation profile, which may be driver specific, maybe generated and stored at 4700. For example, the acceleration of thevehicle corresponding to turning may be stored. In some embodiments, thevehicle operation profile may include an aggregation of vehicleoperation information. In some embodiments, acceptability metrics may beadjusted based on stored information, such as vehicle operation profileinformation.

Although not shown separately in FIG. 4, in some embodiments, vehicleoperation assistance information management may include maintaining, ormanaging, stored vehicle operation assistance information. For example,vehicle operation assistance information management may includeperiodically, or in response to an event, deleting or archiving vehicleoperation assistance information. In some embodiments, managing thevehicle operation assistance information may include updatinginformation, such as the acceptability metrics, the vehicle operationassistance information representations. For example, a pictographic oraudio representation may be modified or updated.

In some embodiments, identifying the vehicle operation assistanceinformation at 4100 may include identifying a vehicle operationassistance information item based on previously identified vehicleoperation assistance information as indicated by the broken line shownon the left of FIG. 4. For example, vehicle operation assistanceinformation management may include identifying a first vehicle operationassistance information item at 4100, may store information representingthe first vehicle operation assistance information item at 4700, maymonitor the information stored at 4700, and may identify a secondvehicle operation assistance information item based on the first vehicleoperation assistance information item at 4100. In another example,vehicle operation assistance information management may includeidentifying a first vehicle operation assistance information item at4100, may present a representation of the first vehicle operationassistance information item at 4500, may monitor the informationpresented at 4500, and may identify a second vehicle operationassistance information item based on the first vehicle operationassistance information item at 4100.

In some embodiments, identifying the second vehicle operation assistanceinformation item based on the first vehicle operation assistanceinformation item at 4100 may include copying the vehicle operationassistance information from the first vehicle operation assistanceinformation item to the second vehicle operation assistance information,or using the first vehicle operation assistance information item as thesecond vehicle operation assistance information item.

In some embodiments, monitoring stored or currently presented vehicleoperation assistance information may include periodically, or inresponse to an event, such as traversing a defined geospatial distancein the vehicle transportation network at 4600, determining whether toidentify a vehicle operation assistance information item based on apreviously identified vehicle operation assistance information item at4100.

For example, vehicle operation assistance information management mayinclude identifying a first vehicle operation assistance informationitem at 4100, may determine that the immanency for the first vehicleoperation assistance information item exceeds a maximum relevantimmanence at 4200, may store the first vehicle operation assistanceinformation item at 4700, may subsequently identify the first vehicleoperation assistance information item as a second vehicle operationassistance information item, may evaluate the second vehicle operationassistance information item, and may determine that the immanency forthe second vehicle operation assistance information item is with themaximum relevant immanence at 4200, such as where the vehicle traversedthe vehicle transportation network at 4600 to move closer to thegeographic location indicated by the vehicle operation assistanceinformation.

In another example, vehicle operation assistance information managementmay include identifying a first vehicle operation assistance informationitem at 4100, may determine that the immanency for the first vehicleoperation assistance information item is 15 seconds at 4200, may presentthe first vehicle operation assistance information item as advancevehicle operation assistance information at 4500, may subsequentlyidentify the first vehicle operation assistance information item as asecond vehicle operation assistance information item, may evaluate thesecond vehicle operation assistance information item, may determine thatthe immanency for the second vehicle operation assistance informationitem is ten seconds at 4200, and may present the second vehicleoperation assistance information item as advisory vehicle operationassistance information at 4500. Vehicle operation assistance informationmanagement may include subsequently identifying the second vehicleoperation assistance information item as a third vehicle operationassistance information item, may evaluate the third vehicle operationassistance information item, may determine that the immanency for thethird vehicle operation assistance information item is four seconds at4200, and may present the third vehicle operation assistance informationitem as warning vehicle operation assistance information at 4500.

In another example, vehicle operation assistance information managementmay include identifying a first vehicle operation assistance informationitem at 4100, may determine that the immanency for the first vehicleoperation assistance information item exceeds a maximum relevantimmanence at 4200, may store the first vehicle operation assistanceinformation item at 4700, may subsequently identify a second vehicleoperation assistance information item at 4100, such as based on sensorinformation indicating a front impact collision warning, may evaluatethe second vehicle operation assistance information item, may presentthe second vehicle operation assistance information item as warningvehicle operation assistance information at 4500, may subsequently ceasepresenting the second vehicle operation assistance information item, maysubsequently identify the first vehicle operation assistance informationitem as a third vehicle operation assistance information item, mayevaluate the third vehicle operation assistance information item, andmay determine that the immanency for the third vehicle operationassistance information item is with the maximum relevant immanence at4200, such as where the vehicle traversed the vehicle transportationnetwork at 4600 to move closer to the geographic location indicated bythe vehicle operation assistance information.

In some embodiments, one or more elements of vehicle operationassistance information may be implemented in an external device. Forexample, identifying a vehicle operation assistance information item at4100, identifying an immanency for the vehicle operation assistanceinformation item at 4200, determining an urgency at 4300; determining autility metric at 4400, storing information representing the vehicleoperation assistance information item at 4700, or a combination thereof,may be implemented in an external device, the vehicle may communicatewith the external device via a wireless electronic communication link,the vehicle may receive processed, or partially processed, vehicleoperation assistance information from the external device, and thevehicle may utilize the vehicle operation assistance information item at4500.

FIG. 5 is a diagram of determining an immanency in accordance with thisdisclosure. In some embodiments, an immanency may indicate spatial ortemporal distance between the vehicle and a geospatial location in thevehicle transportation network indicated by vehicle operation assistanceinformation, such as the vehicle operation assistance informationidentified as shown at 4100 in FIG. 4.

In some embodiments, determining the immanency at 5000 may includeidentifying current operational parameters for the vehicle at 5100,identifying a target location at 5200, determining an intersectionprobability at 5300, identifying a cost at 5400, or a combinationthereof.

In some embodiments, the vehicle operation assistance information mayinclude an express or implied immanency and one or more elements ofdetermining an immanency, such as identifying a target location at 5200,determining an intersection probability at 5300, or identifying a costat 5400, may be omitted. For example, the vehicle operation assistanceinformation may indicate front collision information. In someembodiments, the front collision information may expressly indicate anexpected time to collision, such as three or four seconds, which may beidentified as the immanency. In some embodiments, the front collisioninformation may omit an express immanency, and a defined front collisionimmanency, such as three or four seconds, may be identified as theimmanency.

In some embodiments, current operational parameters for the vehicle maybe identified at 5100. In some embodiments, identifying the currentoperational parameters at 5100 may include identifying a currentgeospatial location of the vehicle, a current vehicle operational statefor the vehicle, a current expected path for the vehicle, or acombination thereof. In some embodiments, the current geospatiallocation of the vehicle may be identified contemporaneously withidentifying the vehicle operation assistance information.

In some embodiments, identifying the current vehicle operational stateof the vehicle may include identifying a current heading for thevehicle, identifying a current speed of the vehicle, identifying acurrent acceleration for the vehicle, identifying a current active turnsignal for the vehicle, or identifying any other current operationalcharacteristic, or combination of characteristics for the vehicle.

In some embodiments, the current expected path for the vehicle may beidentified based on the current vehicle location, the current vehicleoperational state, the vehicle transportation network topology for aportion of the vehicle transportation network within a definedgeospatial distance from the current location of the vehicle, a definedroute for the vehicle, such as a route identified in a navigationsystem, or a combination thereof. For example, referring to FIG. 3, thecurrent expected path for the host vehicle 3200 may indicate that thehost vehicle 3200 is expected to travel from the current location of thehost vehicle 3200 as shown in the right hand lane 3030.

In some embodiments, a target location may be identified at 5200. Insome embodiments, the vehicle operation assistance information mayindicate a geospatial location within the vehicle transportationnetwork, such as a geospatial point, which may be indicated by, forexample, GPS coordinates, a feature of the vehicle transportationnetwork, such as a lane or a road, or a portion thereof, which may beindicated by two or more geospatial locations, such as a firstgeospatial location along a the vehicle transportation network featurecorresponding to an edge of the portion of the vehicle transportationnetwork feature indicated by the vehicle operation assistanceinformation and a second geospatial location along the vehicletransportation network feature corresponding to an opposite edge of theportion of the vehicle transportation network feature indicated by thevehicle operation assistance information.

For example, referring to FIG. 3, the portion of the lane 3030 thatincludes the host vehicle 3200 may be associated with a higher speedlimit than the portion of the lane 3030 near the top of FIG. 3, thevehicle operation assistance information may indicate reduce speed zoneinformation and may indicate one or more locations within the vehicletransportation network, such as a geospatial location of a portion ofthe lower speed portion of the vehicle transportation network mostproximate to the higher speed portion of the vehicle transportationnetwork as indicated at 3300.

In some embodiments, an intersection probability may be determined at5300. The intersection probability may be determined based on thecurrent operational parameters identified at 5100, the target locationidentified at 5200, or a combination thereof. For example, determiningthe intersection probability at 5300 may include determining whether thecurrent expected path for the vehicle identified at 5100 intersects witha portion of the vehicle transportation network indicated by the vehicleoperation assistance information, which may correspond with the targetlocation identified at 5200. In some embodiments, identifying the targetlocation at 5200 may include identifying the most proximal geospatiallocation in the vehicle transportation network corresponding to thegeospatial location information indicated in the vehicle operationassistance information, along, or within a defined buffer distance from,the current expected path for the vehicle.

For example, a portion of the vehicle transportation network may includea highway and an exit ramp, the highway may include an exit lane, whichmay intersect with the exit ramp, and a non-exit lane, which may notintersect with the exit ramp, the vehicle may traverse the highway inthe non-exit lane to a geospatial location approaching the exit ramp,vehicle operation assistance information management may includeidentifying vehicle operation assistance information indicating reducedspeed zone information for the exit ramp, vehicle operation assistanceinformation management may include determining that the current expectedpath for the vehicle includes the non-exit lane at 5100, vehicleoperation assistance information management may include identifying theintersection of the exit lane with the exit ramp as the target locationat 5200, and vehicle operation assistance information management mayinclude identifying a low intersection probability at 5300, which mayindicate a determination of a low probability that the vehicle willtraverse the portion of the vehicle transportation network indicated bythe vehicle operation assistance information.

In another example, a portion of the vehicle transportation network mayinclude a highway and an exit ramp, the highway may include an exitlane, which may intersect with the exit ramp, and a non-exit lane, whichmay not intersect with the exit ramp, the vehicle may traverse thehighway in the exit lane to a geospatial location approaching the exitramp, vehicle operation assistance information management may includeidentifying vehicle operation assistance information indicating reducedspeed zone information for the exit ramp, vehicle operation assistanceinformation management may include determining that the current expectedpath for the vehicle includes the exit lane and the exit ramp at 5100,vehicle operation assistance information management may includeidentifying the intersection of the exit lane with the exit ramp as thetarget location at 5200, and vehicle operation assistance informationmanagement may include identifying a high intersection probability at5300, which may indicate a determination of a high probability that thevehicle will traverse the portion of the vehicle transportation networkindicated by the vehicle operation assistance information.

In some embodiments, the intersection probability identified at 5300 maybe within, such as less than or equal to, a minimum relevance threshold,which may indicate a maximum intersection probability that is notcurrently relevant to vehicle operation, and the vehicle operationassistance information may be identified as not currently relevant. Forexample, information representing the vehicle operation assistanceinformation may be stored, or a value exceeding a maximum relevantimmanence may be identified as the immanency for the vehicle operationassistance information. In some embodiments, the maximum relevantimmanence may indicate a maximum temporal or geospatial distance, fromthe current geospatial location of the vehicle, based on the currentoperating characteristics of the vehicle, such as the speed and expectedpath of the vehicle, which may affect the current operation of thevehicle. For example, an immanency exceeding the maximum relevantimmanence may indicate that the geospatial or temporal distance betweenthe current location of the vehicle and the geospatial locationindicated by the vehicle operation assistance information is so largethat the vehicle operation assistance information is not currentlyrelevant to the operation of the vehicle. In some embodiments, themaximum relevant immanence may be a defined value, such as 30 seconds.In some embodiments, the maximum relevant immanence may be calculated.For example, the maximum relevant immanence may be calculated based oncurrent vehicle transportation network conditions, the current vehicleoperating state, user input, such as a driver preference, or acombination thereof.

In some embodiments, a cost may be identified at 5400. In someembodiments, the intersection probability identified at 5300 may exceed,such as be greater than, the minimum relevance threshold, which mayindicate that the vehicle operation assistance information may berelevant to the current vehicle operation, and a cost, such as a spatialor temporal cost, for the vehicle to traverse the vehicle transportationnetwork from the current geospatial location of the vehicle identifiedat 5100 to the target geospatial location identified at 5200 using theexpected path identified at 5100 may be identified as the cost at 5400.For example, a geospatial distance in the vehicle transportation networkbetween the current geospatial location of the vehicle identified at5100 and the target geospatial location identified at 5200 may beidentified as a spatial cost, or a temporal distance, which may indicatean amount of time, for the vehicle to traverse the vehicletransportation network from the current geospatial location of thevehicle identified at 5100 to the target geospatial location identifiedat 5200 based on the current vehicle operating parameters, such asspeed, identified at 5100, may be identified as the cost.

FIG. 6 is a diagram of determining urgency in accordance with thisdisclosure. In some embodiments, determining the urgency may includedetermining a temporal or spatial distance available for utilizing thevehicle operation assistance information to traverse the vehicletransportation network and quantizing, or categorizing, the temporal orspatial distance into a defined set of urgency types, categories, orbands. For example, a relatively small temporal or spatial distance maybe categorized as high, or warning, urgency; a relatively large temporalor spatial distance may be categorized as low, or advance, urgency; anda temporal or spatial distance between the warning urgency and theadvance urgency may be categorized as moderate, or advisory, urgency.Although three urgency bands, or categories, are described herein, anynumber and organization of urgency bands may be used. For example, theadvisory urgency may be replaced with a low advisory urgency, greaterthan, or more urgent than, the advance urgency, and a high advisoryurgency, greater than the low advisory urgency and less urgent than thewarning urgency. In some embodiments, determining urgency at 6000 may besimilar to the urgency determination shown at 4300 in FIG. 4.

In some embodiments, determining urgency at 6000 may include identifyinga vehicle control action at 6100, determining an advisory action cost at6200, evaluating an advisory cost at 6300, determining a warning actioncost at 6400, evaluating a warning cost at 6500, or a combinationthereof.

In some embodiments, the vehicle operation assistance information mayindicate an express or implied urgency and determining urgency at 6000may include using the urgency included in the vehicle operationassistance information as the urgency. For example, a vehicle operationassistance information item, such as a front collision vehicle operationassistance information item, may expressly indicate a warning urgency,which may be identified as the urgency. In another example, a vehicleoperation assistance information item, such as a front collision vehicleoperation assistance information item, which may omit an expressurgency, may be associated with a defined urgency, such as the warningurgency, and the defined urgency may be identified as the urgency.

In some embodiments, an available vehicle control action responsive tothe vehicle operation assistance information may be identified at 6100.A vehicle control action may indicate a vehicle control action,operation, or maneuver, such as accelerating, decelerating, turning, orstopping, that may be performed by the vehicle, such as in response todriver input, to traverse a portion of the vehicle transportationnetwork.

In some embodiments, available vehicle control actions may be identifiedat 6100 based on vehicle operation assistance information and thecurrent vehicle operational conditions. For example, a vehicle operationassistance information item may indicate a reduced speed zone, thecurrent vehicle operational conditions may indicate a speed greater thana speed limit for the reduced speed zone, and a deceleration vehiclecontrol action may be identified. In another example, the currentvehicle operational conditions may indicate that the vehicle is turning,the vehicle operation assistance information item may indicate that thevehicle is turning into oncoming traffic, and a vehicle control actionthat indicates that it is safe to proceed, or that it is unsafe toproceed,

In some embodiments, a vehicle control action responsive to the vehicleoperation assistance information may be unavailable and an availablevehicle control action responsive to the vehicle operation assistanceinformation may not be identified at 6100. For example, a vehicleoperation assistance information item may indicate a reduced speed zone,the current vehicle operational conditions may indicate a speed withinthe speed limit for the reduced speed zone, and a vehicle control actionresponsive to the vehicle operation assistance information may beunavailable.

In some embodiments, vehicle operation assistance information mayindicate a defined vehicle operational condition, such as a speed limit,and a corresponding vehicle control action responsive to the vehicleoperation assistance information may indicate a corresponding targetvehicle operational condition, such as a target maximum speed. In someembodiments, the target vehicle operational control condition may bebased on a defined vehicle operational condition and may differ from thedefined vehicle operational condition. For example, a vehicle operationassistance information may indicate a defined speed and thecorresponding target maximum speed may differ from the speed limit by adefined offset, which may be greater than the defined speed indicated bythe vehicle operation assistance information.

In some embodiments, an advisory action cost may be identified at 6200.In some embodiments, an action cost may indicate a cost, such as atemporal cost or a spatial cost, for the vehicle to traverse the vehicletransportation network in accordance with an identified vehicle controlaction, such as the vehicle control action identified at 6100, based onthe current vehicle operational conditions and one or more acceptabilitymetrics.

In some embodiments, acceptability metrics may include safety metrics,such as metrics indicating collision avoidance; vehicle transportationnetwork control compliance metrics, such as metrics indicatingcompliance with vehicle transportation network rules and regulations,such as a speed limit; physical capability metrics, such as metricsindicating a maximum braking capability of the vehicle; or any othermetric related to vehicle operation. In some embodiments, anacceptability metric may indicate a defined rate, range, or limit. Forexample, a vehicle control action may indicate a reduction in speed, anda corresponding acceptability metric may indicate a defined target rateof deceleration, a defined range of deceleration rates, or a definedmaximum rate of deceleration.

In some embodiments, an acceptability metric may be based on a balancedcombination of passenger comfort and safety. For example, a comfortabledeceleration acceptability metric may indicate a maximum decelerationrate of 11 feet per second squared. In some embodiments, anacceptability may be based on maximizing safety or avoiding a collision.For example, an emergent deceleration acceptability metric may indicatea maximum rate of deceleration, such as a deceleration rate greater than11 feet per second squared.

In some embodiments, a vehicle control action responsive to the vehicleoperation assistance information may be unavailable, or an availablevehicle control action responsive to the vehicle operation assistanceinformation may not be identified at 6100, and the advisory action costidentified at 6200 may be a defined advisory action cost, which may be adefined temporal cost, such as eight seconds.

In some embodiments, the advisory action cost identified at 6200 may bea determined advisory action cost, which may indicate a temporal costfor the vehicle to traverse the vehicle transportation network inaccordance with a vehicle control action, such as the vehicle controlaction identified at 6100, and a corresponding advisory acceptabilitymetric.

For example, a vehicle operation assistance information item mayindicate a reduced speed zone, the current vehicle operationalconditions may indicate a speed greater than a defined speed for thereduced speed zone; a deceleration vehicle control action may beidentified at 6100, which may indicate a target maximum speed; anadvisory deceleration acceptability metric may indicate an acceptable,or comfortable, rate of deceleration, such as a deceleration rate of 11feet per second squared or less; and the determined advisory action costidentified at 6200 may indicate a temporal cost for the vehicle totraverse the vehicle transportation network by reducing speed from thecurrent speed of the vehicle to the target maximum speed at adeceleration rate of 11 feet per second squared. In someimplementations, one or more metrics may be identified based on driverinformation, such as an age of the driver, a vehicle operation profileassociated with the driver, a licensing class of the driver, or thelike.

In some embodiments, an advisory cost may be evaluated at 6300. In someembodiments, evaluating the advisory cost at 6300 may includeidentifying the advisory cost. In some embodiments, the advisory costmay be based on the advisory action cost identified at 6200 and anadvisory offset, such as two seconds. For example, the advisory actioncost identified at 6200 may be eight seconds, the advisory offset may betwo seconds, and the advisory cost may be identified as a sum of theaction cost and the advisory offset, such as ten seconds. In someembodiments, evaluating the advisory cost at 6300 may includedetermining whether an immanency, such as the immanency identified asshown at 4200 in FIG. 4 or as shown in FIG. 5, exceeds the advisorycost.

In some embodiments, the immanency may exceed the advisory cost and thecurrent urgency may be identified as the advance urgency at 6310. Forexample, an immanency, such as the immanency identified as shown at 4200in FIG. 4 or as shown in FIG. 5, may be twelve seconds, the advisoryaction cost identified at 6200 may be eight seconds, the advisory offsetmay be two seconds, the advisory cost may be ten seconds (8+2=10), theimmanency may exceed the advisory cost (12>10), and the current urgencymay be identified as the advance urgency at 6310. Identifying thecurrent urgency as the advanced urgency at 6310 may indicate that morethan enough time, or space, is available for the vehicle to traverse thevehicle transportation network in accordance with the vehicle operationassistance information and the advisory acceptability metric.

In some embodiments, the immanency may be within the advisory cost and awarning action cost may be determined at 6400. In some embodiments, thewarning action cost identified at 6400 may indicate temporal cost forthe vehicle to traverse the vehicle transportation network in accordancewith the vehicle control action identified at 6100 and a correspondingwarning acceptability metric. For example, a vehicle operationassistance information item may indicate a front collision, a stopvehicle control action may be identified at 6100, a warning decelerationacceptability metric may indicate an emergent rate of deceleration,which may be a rate of deceleration at or near a maximum practicablerate, such as a deceleration rate greater than 11 feet per secondsquared, and the warning action cost identified at 6400 may indicate atemporal cost for the vehicle to traverse the vehicle transportationnetwork by reducing speed from the current speed of the vehicle to zeroat a deceleration rate greater than 11 feet per second squared.

In some embodiments, a vehicle control action responsive to the vehicleoperation assistance information may be unavailable, or an availablevehicle control action responsive to the vehicle operation assistanceinformation may not be identified at 6100, and a defined warning actioncost, which may be a defined temporal cost, such as four seconds, may beidentified as the warning action cost at 6400.

In some embodiments, a warning cost may be evaluated at 6500. In someembodiments, evaluating the warning cost at 6500 may include identifyingthe warning cost. In some embodiments, the warning cost may be based onthe warning action cost identified at 6400 and a warning offset, such asone second. For example, the warning action cost identified at 6400 maybe three seconds, the warning offset may be one second, and the warningcost may be identified as a sum of the warning action cost and thewarning offset, such as four seconds. In some embodiments, evaluatingthe warning cost at 6500 may include determining whether an immanency,such as the immanency identified as shown at 4200 in FIG. 4 or as shownin FIG. 5, exceeds the warning cost.

In some embodiments, the immanency may exceed the warning cost and thecurrent urgency may be identified as the advisory urgency at 6510. Forexample, the immanency, such as the immanency identified as shown at4200 in FIG. 4 or as shown in FIG. 5, may be six seconds, the warningaction cost identified at 6400 may be three seconds, the warning offsetmay be one second, the warning cost may be four seconds (3+1=4), theimmanency may exceed the warning cost (6>4), and the current urgency maybe identified as the advisory urgency at 6510. Identifying the currenturgency as the advisory urgency at 6510 may indicate that more thanenough time, or space, may be available for the vehicle to traverse thevehicle transportation network in accordance with the vehicle operationassistance information and the warning acceptability metric, and that aminimal, or lower, amount of time, or space, may be available for thevehicle to traverse the vehicle transportation network in accordancewith the vehicle operation assistance information and the advisoryacceptability metric.

In some embodiments, the immanency may be within the warning cost andthe current urgency may be identified as the warning urgency at 6520.For example, the immanency, such as the immanency identified as shown at4200 in FIG. 4 or as shown in FIG. 5, may be three seconds, the warningaction cost identified at 6400 may be three seconds, the warning offsetmay be one second, the warning cost may be four seconds (3+1=4), theimmanency may be within the warning cost (3<=4), and the current urgencymay be identified as the warning urgency at 6520. Identifying thecurrent urgency as the warning urgency at 6520 may indicate that enoughtime, or space, for the vehicle to traverse the vehicle transportationnetwork in accordance with the vehicle operation assistance informationand the advisory acceptability metric is not available, and may indicatethat a minimal, or lower, amount of time, or space, may be available forthe vehicle to traverse the vehicle transportation network in accordancewith the vehicle operation assistance information and the warningacceptability metric.

In some embodiments, the vehicle control action identified at 6100 mayinclude more than one vehicle control action, such as a primary vehiclecontrol action and a secondary vehicle control action. For example, theprimary vehicle control action may include proceeding along the expectedpath for the vehicle, and the secondary vehicle control action mayindicate stopping or waiting before proceeding along the expected pathfor the vehicle.

In some embodiments, an advisory action cost may be identified at 6200for the first, or primary, vehicle control action identified at 6100 anda corresponding primary advisory cost may be identified at 6300. In someembodiments, the immanency may exceed the primary advisory cost, theurgency may be identified as the advance urgency at 6310, and evaluatingthe secondary vehicle control action may be omitted. In someembodiments, the immanency may be within the primary advisory cost, aprimary warning action cost may be determined at 6400, and a primarywarning cost may be evaluated at 6500. In some embodiments, theimmanency may exceed the primary warning cost, the urgency may beidentified as the advisory urgency at 6510 in association with theprimary vehicle control action, and evaluating the secondary vehiclecontrol action may be omitted. In some embodiments, the immanency may bewithin the primary warning cost, a warning action cost for the secondaryvehicle control action may be determined at 6400, and a secondarywarning cost may be evaluated at 6500. In some embodiments, theimmanency may exceed the secondary warning cost, and the urgency may beidentified as the advisory urgency at 6510 in association with thesecondary vehicle control action. In some embodiments, the immanency maybe within the secondary warning cost, and the urgency may be identifiedas the warning urgency at 6510 in association with the secondary vehiclecontrol action.

For example, the expected path for the vehicle may include a turn thatintersects with oncoming traffic. The vehicle operation assistanceinformation may indicate oncoming traffic information. A primary vehiclecontrol action indicating proceeding with the turn, and a secondaryvehicle control action indicating to stop, such as where the currentvehicle state information indicates that the vehicle is moving, or wait,such as where the current vehicle state information indicates that thevehicle is stationary, may be identified at 6100.

An advisory action cost may be identified for the primary vehiclecontrol action at 6200. The primary advisory action cost may beidentified based on an advisory acceptability metric associated with theprimary vehicle control action. For example, the advisory acceptabilitymetric may indicate an acceptable minimum distance, such as eightseconds, between the vehicle and an identified point of impact betweenthe vehicle, along the expected path of the vehicle, and the mostproximate oncoming remote vehicle, along an expected path for the remotevehicle. In some embodiments, the acceptable minimum distance may bedetermined based on an acceptable advisory acceleration rate, anacceptable advisory angular force, or a combination thereof, forproceeding with traversing the vehicle transportation network by turningthrough the intersection. The immanency may be within the primaryadvisory cost evaluated at 6300, which may indicate that the identifiedpoint of impact between the vehicle, along the expected path of thevehicle, and the most proximate oncoming remote vehicle, along anexpected path for the remote vehicle is within, for example, tenseconds, a primary warning action cost may be determined at 6400, and aprimary warning cost may be evaluated at 6500.

In some embodiments, the immanency may exceed the primary warning cost,the urgency may be identified as the advisory urgency at 6510 inassociation with the primary vehicle control action, which maycorrespond with presenting an advisory to proceed, as indicated by theprimary vehicle control action, and evaluating the secondary vehiclecontrol action may be omitted.

In some embodiments, the immanency may be within the primary warningcost, which may indicate that the identified point of impact between thevehicle, along the expected path of the vehicle, and the most proximateoncoming remote vehicle, along an expected path for the remote vehicleis within, for example, five seconds, a warning action cost for thesecondary vehicle control action may be determined at 6400, and asecondary warning cost may be evaluated at 6500. In some embodiments,the immanency may exceed the secondary warning cost, and the urgency maybe identified as the advisory urgency at 6510 in association with thesecondary vehicle control action, which may correspond with presentingan advisory to not proceed, such as “Caution—yield to oncoming traffic”.In some embodiments, the immanency may be within the secondary warningcost, and the urgency may be identified as the warning urgency at 6510in association with the secondary vehicle control action, which maycorrespond with presenting a warning to not proceed, such as“Stop—potential collision”.

FIG. 7 is a diagram of determining a utility metric in accordance withthis disclosure. In some embodiments, a defined set of utility metricsmay be used, such as a low utility and a high utility. In someembodiments, the low utility may be indicated that vehicle operationassistance information, such as the vehicle operation assistanceinformation identified as shown at 4100 in FIG. 4, may be stored andthat other contemporaneous use of the vehicle operation assistanceinformation may be omitted. In some embodiments, the high utility mayindicate that the vehicle operation assistance information may becontemporaneously used for traversing the vehicle transportationnetwork. Although two utility metrics are described herein, any numberof utility metrics may be used. For example, a low utility, a mediumutility, and a high utility may be used. In some embodiments,determining a utility metric at 7000 may be similar to the utilitydetermination shown at 4400 in FIG. 4.

In some embodiments, determining a utility metric at 7000 may includeevaluating a current display status at 7100, evaluating a currenturgency at 7200, evaluating a vehicle operation risk metric at 7300,evaluating the warning action cost at 7310, evaluating a previousurgency at 7330, evaluating the vehicle control action at 7400,evaluating the current urgency at 7500, evaluating the vehicletransportation network status indicated by the vehicle operationassistance information at 7600, evaluating a frequency for the vehicleoperation assistance information at 7700, evaluating a call status at7800, evaluating an intersecting path cost at 7900, or a combinationthereof.

In some embodiments, the vehicle operation assistance information mayinclude an express or implied utility metric and one or more elements ofdetermining the utility metric at 7000 may be omitted. For example, avehicle operation assistance information item, such as a front collisionvehicle operation assistance information item, may expressly indicate ahigh utility, which may be identified as the utility metric. In anotherexample, a front collision vehicle operation assistance information itemmay omit an express urgency, may be associated with a defined utility,such as a high utility, and the defined utility may be identified as theutility metric.

In some embodiments, a vehicle information presentation status may beidentified at 7100. The vehicle information presentation statusidentified at 7100 may indicate an information presentation status ofone or more user interface units of the vehicle, such as the userinterface 1350 shown in FIG. 1. For example, the vehicle may include agraphical display unit and the vehicle information presentation statusmay indicate that the graphical display unit is not currently displayinginformation, that the graphical display unit is currently displayingnavigation information, or that the graphical display unit is currentlydisplaying information representing previously identified vehicleoperation assistance information. In some embodiments, the vehicleinformation presentation status identified at 7100 may indicate that theuser interface unit is currently displaying other information, such asinformation other than navigation information or informationrepresenting vehicle operation assistance information.

In some embodiments, the vehicle information presentation statusidentified at 7100 may indicate that the user interface unit iscurrently displaying information representing previously identifiedvehicle operation assistance information, and identifying the vehicleinformation presentation status at 7100 may include identifying anurgency associated with the previously identified vehicle operationassistance information. For simplicity and clarity, the urgencyassociated with the previously identified vehicle operation assistanceinformation may be referred to herein as the previous urgency.

In some embodiments, the previous urgency identified at 7100 may exceedthe current urgency, which may be, for example, the current urgencyidentified as shown at 4300 in FIG. 4 or as shown in FIG. 6, and a lowutility may be identified as the utility metric at 7110. For example,the previous urgency may be the warning urgency, the current urgency maybe the advisory urgency or the advance urgency, and a low utility may beidentified as the utility metric. In another example, the previousurgency may be the advisory urgency, the current urgency may be theadvance urgency, and a low utility may be identified as the utilitymetric.

In some embodiments, the current urgency may be evaluated at 7200. Forexample, the previous urgency identified at 7100 may be within thecurrent urgency, or the vehicle information presentation status may omitinformation that indicates a previously identified vehicle operationassistance information item, and the current urgency may be evaluated at7200. In an example, the previous urgency may be the warning urgency,the current urgency may be the warning urgency, and the current urgencymay be evaluated at 7200. In another example, the previous urgency maybe the advisory urgency, the current urgency may be the warning urgencyor the advisory urgency, and the current urgency may be evaluated at7200. In another example, the previous urgency may be the advanceurgency, the current urgency may be the warning urgency, the advisoryurgency, or the advance urgency, and the current urgency may beevaluated at 7200.

In some embodiments, evaluating the current urgency at 7200 may includedetermining whether the current urgency is the warning urgency. Forexample, the current urgency may be the warning urgency and a vehicleoperation risk metric may be evaluated at 7300. In another example, thecurrent urgency may be the advance urgency or the advisory urgency andthe vehicle control action may be evaluated at 7400.

In some embodiments, the vehicle operation risk metric may be evaluatedat 7300. For example, the current urgency may indicate a warning urgencyand the vehicle operation risk metric may be evaluated at 7300. In someembodiments, evaluating the vehicle operation risk metric at 7300 mayinclude determining the vehicle operation risk metric. In someembodiments, the vehicle operation risk metric may indicate a pattern,such as a risk tolerance pattern, associated with recent vehicleoperations, which may include vehicle operations performed within adefined temporal period, such as two hours; vehicle operations performedafter leaving a defined location, such as a home location or a worklocation defined for a driver of the vehicle; or vehicle operationsperformed after a defined event, such as a parked event. In someembodiments, a high vehicle operation risk metric may indicate risktolerant vehicle operation and a low vehicle operation risk metric mayindicate risk intolerant vehicle operation. In some embodiments,determining the vehicle operation risk metric at 7300 may be similar todetermining the vehicle operation risk metric as shown at 8000 in FIG.8.

In some embodiments, a warning action cost may be evaluated at 7310. Forexample, the vehicle operation risk metric identified at 7300 may exceeda defined risk tolerance threshold, which may indicate risk tolerantvehicle operation, and the warning action cost may be evaluated at 7310.The warning action cost may indicate a temporal cost, such as thewarning action cost identified as shown at 6400 in FIG. 6, for thevehicle to traverse the vehicle transportation network in accordancewith a vehicle control action, such as the vehicle control actionidentified as shown at 6100 in FIG. 6, and a corresponding warningacceptability metric. In some embodiments, evaluating the warning actioncost at 7310 may include determining whether the immanency, such as theimmanency identified as shown at 4200 in FIG. 4 or as shown in FIG. 5,exceeds the warning action cost at 7310 may be similar to thedetermination whether the immanency exceeds the warning cost shown at6500 in FIG. 6, except that the warning offset may be omitted.

In some embodiments, the immanency may exceed the warning action cost,which may indicate that more than enough time, or space, is availablefor the vehicle to traverse the vehicle transportation network inaccordance with the vehicle operation assistance information and thewarning acceptability metric, and a low utility may be identified forthe vehicle operation assistance information at 7311. Identifying a lowutility for a vehicle operation risk metric that exceeds a defined riskthreshold and an immanency that exceeds the warning action cost maysuppress unwanted warnings.

In some embodiments, the immanency may be within the warning actioncost, which may indicate that a minimal, or lower, amount of time, orspace, is available for the vehicle to traverse the vehicletransportation network in accordance with the vehicle operationassistance information, and a high utility may be identified for thevehicle operation assistance information at 7312.

In some embodiments, the vehicle operation risk metric identified at7300 may be within the defined risk tolerance threshold, which mayindicate risk intolerant vehicle operation, and a high utility may beidentified for the vehicle operation assistance information at 7320.

In some embodiments, identifying the utility metric as indicating a highutility at 7312/7320 may include evaluating the previous urgency at7330. In some embodiments, the vehicle information presentation statusmay omit information that indicates a previously identified vehicleoperation assistance information item and evaluating the previousurgency at 7330 may be omitted. In some embodiments, the previousurgency may be the warning urgency, and a low utility may be identifiedfor the vehicle operation assistance information at 7331. In someembodiments, identifying a low utility for the vehicle operationassistance information at 7331 where the previous urgency is the warningurgency may suppress the concurrent presentation of multiple warnings,which may be distracting or confusing. Although not shown in FIG. 7, insome embodiments, identifying a low utility for the vehicle operationassistance information at 7331 may be omitted, and multiple warnings maybe concurrently presented.

In some embodiments, a vehicle control action may be evaluated at 7400.In some embodiments, evaluating the vehicle control action at 7400 mayinclude identifying the vehicle control action, which may be similar toidentifying the vehicle control action as shown at 6100 in FIG. 6. Insome embodiments, a vehicle control action may be unavailable, and a lowutility may be identified for the vehicle operation assistanceinformation at 7410. In some embodiments, identifying a low utility forthe vehicle operation assistance information at 7410 where the currenturgency is the advance urgency or the advisory urgency and a vehiclecontrol action is unavailable may suppress the use of unwanted vehicleoperation assistance information. In some embodiments, an availablevehicle control action may be identified at 7400, and the currenturgency may be evaluated at 7500.

In some embodiments, evaluating the current urgency, which may be, forexample, the current urgency identified as shown at 4300 in FIG. 4 or asshown in FIG. 6, at 7500 may include determining whether the currenturgency is the advisory urgency. For example, the current urgency may bethe advisory urgency and a high utility may be identified for thevehicle operation assistance information at 7520. In some embodiments,identifying a high utility for the vehicle operation assistanceinformation at 7520 where the current urgency is the advisory urgency avehicle control action is available may encourage the use of currentlyactionable vehicle operation assistance information. In another example,the current urgency may be the advance urgency and a vehicletransportation network status may be evaluated at 7600.

In some embodiments, evaluating the vehicle transportation networkstatus at 7600 may include identifying the vehicle transportationnetwork status. For example, the vehicle transportation network statusmay be identified based on the vehicle operation assistance information.In some embodiments, the vehicle operation assistance information mayinclude an express vehicle transportation network status. In someembodiments, the vehicle operation assistance information may omit anexpress indication of a vehicle transportation network status, and animplied vehicle transportation network status may be determined for thevehicle operation assistance information, such as from a database,look-up table, or other information store. In some embodiments,

In some embodiments, the vehicle transportation network statuscorresponding to a vehicle operation assistance information may beidentified as an expected status or an abnormal status. An expectedstatus may indicate a vehicle transportation network condition orcharacteristic that defines the corresponding portion of the vehicletransportation network. For example, a vehicle operation assistanceinformation item may indicate a school zone, which may indicate areduced speed when children are present, which may be a vehicletransportation network condition or characteristic that defines theschool zone portion of the vehicle transportation network, and thevehicle transportation network status for the vehicle operationassistance information item may be identified as an expected status. Anabnormal vehicle transportation network status may indicate a vehicletransportation network condition or characteristic that differs orvaries from the definition of the corresponding portion of the vehicletransportation network. For example, a vehicle operation assistanceinformation item may indicate a disabled vehicle, which may vary fromthe definition of the corresponding portion of the vehicletransportation network, and the vehicle transportation network statusfor the vehicle operation assistance information item may be identifiedas an abnormal status. In another example, a vehicle operationassistance information item may indicate icy conditions, which may varyfrom the definition of the corresponding portion of the vehicletransportation network, and the vehicle transportation network statusfor the vehicle operation assistance information item may be identifiedas an abnormal status. In another example, a vehicle operationassistance information item may indicate a construction zone, which mayvary from the definition of the corresponding portion of the vehicletransportation network, and the vehicle transportation network statusfor the vehicle operation assistance information item may be identifiedas an abnormal status. In some embodiments, identifying vehicleoperation assistance information as expected or abnormal may includedetermining whether the vehicle operation assistance information differsfrom defined vehicle transportation network information. In someembodiments, identifying vehicle operation assistance information asexpected or abnormal may include determining whether a count of similarvehicle operation assistance information exceeds a defined recognitionthreshold. In some embodiments, the vehicle operation assistanceinformation may include information indicating an emergency vehicle andthe metrics may be replaced with emergency vehicle metrics.

In some embodiments, evaluating the vehicle transportation networkstatus at 7600 may include determining whether the vehicletransportation network status is abnormal. For example, the vehicletransportation network status may be abnormal and a high utility may beidentified for the vehicle operation assistance information at 7620. Insome embodiments, identifying a high utility for the vehicle operationassistance information at 7620 where the vehicle transportation networkstatus is abnormal may encourage the use of currently actionable vehicleoperation assistance information in abnormal conditions. In anotherexample, the vehicle transportation network status may be expected and afrequency metric may be evaluated at 7700.

In some embodiments, evaluating the frequency metric at 7700 may includedetermining the frequency metric, which may represent a measure of howoften, how recently, or a combination of how often and how recently,previously identified vehicle operation assistance information similarto the current vehicle operation assistance information was identified.In some embodiments, determining the frequency metric at 7700 may besimilar to determining the frequency metric as shown at 9000 in FIG. 9.

In some embodiments, evaluating the frequency metric at 7700 may includedetermining whether the frequency metric indicates a low frequency or ahigh frequency. For example, the frequency metric may indicate a lowfrequency and a high utility may be identified for the vehicle operationassistance information at 7720. In some embodiments, identifying a highutility for the vehicle operation assistance information at 7720 wherethe vehicle operation assistance information indicates a low frequencymay encourage the use of currently actionable vehicle operationassistance information in unfamiliar conditions. In another example, thefrequency metric may indicate a high frequency and a call status beevaluated at 7800.

In some embodiments, evaluating the call status at 7800 may includedetermining whether the call status indicates an active call status oran inactive call status. For example, the call status may indicate anactive call status and a low utility may be identified for the vehicleoperation assistance information at 7810. In some embodiments,identifying a low utility for the vehicle operation assistanceinformation at 7810 where the call status indicates an active callstatus may suppress the use of potentially distracting vehicle operationassistance information. In another example, the call status may indicatean inactive call status and a high utility may be identified for thevehicle operation assistance information at 7820. In some embodiments,identifying a high utility for the vehicle operation assistanceinformation at 7820 where the call status indicates an inactive callstatus may encourage the use of currently actionable vehicle operationassistance information. In some embodiments, vehicle operationassistance information management may include temporarily suppressingother information. For example, other information may be omitted fromdisplay, may be displayed behind vehicle operation assistanceinformation, or may be displayed via a tertiary display portion. In someembodiments, the other information may be restored subsequent topresenting the vehicle operation assistance information.

In some embodiments, determining the call status at 7800 may includedetermining whether a wireless telecommunication device indicates anactive call. In some embodiments, the vehicle may include an electroniccommunication unit, such as the electronic communication unit 1320 shownin FIG. 1, configured for wireless telecommunication, and determiningthe call status at 7800 may include determining whether the electroniccommunication unit indicates an active call. For example, the electroniccommunication unit may include a cellular telephone unit. In someembodiments, the electronic communication unit may interface with anexternal wireless telecommunication device. For example, the electroniccommunication unit may include a Bluetooth unit, and may interface withan external wireless telecommunication device via a Bluetooth link. Insome embodiments, determining the call status at 7800 may includedetermining whether a passenger, other than a driver of the vehicle, ispresent in the vehicle. For example, a driver and another passenger maybe present in the vehicle and the call status may be identified asinactive.

In some embodiments, identifying the utility metric as indicating a highutility at 7520/7620/7720/7820 may include evaluating a current expectedpath for the vehicle at 7900. In some embodiments, evaluating thecurrent expected path for the vehicle at 7900 may include identifyingthe current expected path, which may be similar to identifying thecurrent expected path as shown at 5100 in FIG. 5.

In some embodiments, evaluating the current expected path for thevehicle may include identifying a candidate proximal geospatial locationin the vehicle transportation network. In some embodiments, identifyingthe candidate proximal geospatial location may include identifying oneor more candidate proximal geospatial locations based on the currentexpected path for the vehicle and vehicle transportation networkinformation representing a portion of the vehicle transportation networkcorresponding to the current expected path. For example, the vehicletransportation network information may indicate that the currentexpected path intersects with a geo spatial location of a trafficcontrol device, such as a stop sign, and the corresponding geospatiallocation may be identified as a candidate proximal geospatial location.

In some embodiments, evaluating the current expected path for thevehicle may include determining whether the current expected pathintersects with the candidate proximal geospatial location. For example,a previously identified vehicle operation assistance information item,such as the previously identified vehicle operation assistanceinformation identified at 7100, may indicate a geospatial location inthe vehicle transportation network, the current expected path mayintersect with the geospatial location indicated by the previouslyidentified vehicle operation assistance information, and the geospatiallocation indicated by the previously identified vehicle operationassistance information may be identified as a candidate proximalgeospatial location. In another example, a previously identified vehicleoperation assistance information item, such as the previously identifiedvehicle operation assistance information identified at 7100, mayindicate a geospatial location in the vehicle transportation network,the current expected path may not intersect with the geospatial locationindicated by the previously identified vehicle operation assistanceinformation, and the geospatial location indicated by the previouslyidentified vehicle operation assistance information may not beidentified as a candidate proximal geospatial location. In someembodiments, information indicating a traversed path of another vehiclemay correspond with a traversed path of the host vehicle, and a portionof the traversed path information for the other vehicle may beidentified as an expected path for the host vehicle. In someembodiments, the vehicle operation assistance information may beidentified based on previous operation of one or more remote vehicles.For example, an aggregation of vehicle operational informationcorresponding to a geospatial location in the vehicle transportationnetwork may indicate a statistical anomaly, such as statistical sharpdrop in speed, which may indicate vehicles slowing down to avoid anunexpected road hazard, such as a pothole, or a series of small changesin trajectory, which may indicate vehicles swerving to avoid anunexpected road hazard, such as a pothole.

In some embodiments, the current expected path for the vehicle mayintersect with the candidate proximal geospatial location, andevaluating the current expected path at 7900 may include determining atemporal cost for the vehicle to traverse the vehicle transportationnetwork from the current geospatial location of the vehicle in thevehicle transportation network to the candidate proximal geospatiallocation.

In some embodiments, evaluating the current expected path at 7900 mayinclude determining whether an immanency, such as such as the immanencyidentified as shown at 4200 in FIG. 4 or as shown in FIG. 5, exceeds thetemporal cost for the vehicle to traverse the vehicle transportationnetwork from the current geospatial location of the vehicle in thevehicle transportation network to the candidate proximal geospatiallocation.

In some embodiments, the immanency may exceed the temporal cost for thevehicle to traverse the vehicle transportation network from the currentgeospatial location of the vehicle in the vehicle transportation networkto the candidate proximal geospatial location, and a low utility may beidentified for the vehicle operation assistance information at 7910. Insome embodiments, identifying a low utility for the vehicle operationassistance information at 7910 where the immanency exceeds the temporalcost for the vehicle to traverse the vehicle transportation network fromthe current geospatial location of the vehicle in the vehicletransportation network to the candidate proximal geospatial location maysuppress the use of vehicle operation assistance information wherevehicle operation assistance information representing a proximalgeospatial location is available.

FIG. 8 is a diagram of determining a vehicle operation risk metric inaccordance with this disclosure. In some embodiments, the vehicleoperation risk metric may indicate a pattern, such as a risk tolerancepattern, associated with recent vehicle operations. In some embodiments,a high vehicle operation risk metric may indicate risk tolerant vehicleoperation and a low vehicle operation risk metric may indicate riskintolerant vehicle operation. In some embodiments, determining a vehicleoperation risk metric 8000 may be similar to the vehicle operation riskmetric determination shown at 7200 in FIG. 7.

In some embodiments, the vehicle operation risk metric may be determinedat 8000 based on recent vehicle operations, such as vehicle operationsperformed within a defined temporal period, such as two hours; vehicleoperations performed after leaving a defined location, such as a homelocation or a work location defined for a driver of the vehicle; orvehicle operations performed after a defined event, such as a parkedevent.

In some embodiments, determining the vehicle operation risk metric at8000 may include identifying a minimal vehicle operation risk metric at8100, traversing a portion of the vehicle transportation network at8200, identifying information indicating risk tolerant vehicle operationat 8300, incrementing the vehicle operation risk metric at 8400, or acombination thereof.

In some embodiments, a defined minimal vehicle operation risk metric maybe identified at 8100. The defined minimal vehicle operation riskmetric, which may be an integer value, such as zero, may indicate aminimal risk tolerance. In some embodiments, the defined minimal vehicleoperation risk metric may be identified as the current vehicle operationrisk metric. For example, the defined minimal vehicle operation riskmetric may be identified as the current vehicle operation risk metricbased on an event, such as the vehicle starting or powering up, thevehicle leaving the proximity of a defined geospatial location, such asa defined home location or a defined work location, detecting driverchange for the vehicle, or any other event indicative of a likelihoodthat a previously identified vehicle operation risk metric is invalid.In some embodiments, risk tolerance metrics may be identified based onuser input, such as a driver setting.

In some embodiments, the defined minimal vehicle operation risk metricidentified at 8100 may be identified as the current vehicle operationrisk metric in response to the vehicle traversing a portion of thevehicle transportation network. For example, the vehicle may traverse aportion of the vehicle transportation network that correspondsgeospatially with a defined location or origin, such as a home locationor a work location defined for a driver of the vehicle, and the definedminimal vehicle operation risk metric identified at 8100 may beidentified as the current vehicle operation risk metric.

In some embodiments, the vehicle may traverse a portion of the vehicletransportation network at 8200 and information indicating risk tolerantvehicle operations may be identified at 8300.

In some embodiments, identifying information indicating risk tolerantvehicle operations at 8300 may include identifying one or more vehicleoperation assistance information items temporally preceding a currentvehicle operation assistance information, such as the vehicle operationassistance information identified as shown at 4100 in FIG. 4. Each ofthe identified temporally preceding vehicle operation assistanceinformation items that indicates the warning urgency may correspond withrisk tolerant vehicle operations.

In some embodiments, information indicating risk tolerant vehicleoperations may be identified based on other vehicle operationinformation. For example, information indicating risk tolerant vehicleoperations may be identified based on vehicle operation informationindicating a high rate of acceleration, which may indicate a rate ofacceleration greater than a defined comfortable rate of acceleration; ahigh rate of deceleration, which may indicate a rate of decelerationgreater than a defined comfortable rate of deceleration; a high angularmomentum, which may indicate an angular moment greater than a definedcomfortable angular or turn momentum; or a lane change frequency. Insome embodiments, information indicating risk tolerant vehicleoperations may be identified based on identification of one or moreconditions that may reduce driver attention, and risk tolerance may bereduced. In some embodiments, other information, such as a vehicle type,a driving mode profile, which may indicate vehicle configurationsettings, such as handing and acceleration configuration settings. Insome embodiments, information indicating risk tolerant vehicleoperations may be identified based on non-operational information, suchas the presence, age, size, or location in the vehicle, of passengers.For example, the presence of children in the back seat may indicate riskintolerant vehicle operation.

In some embodiments, the vehicle operation risk metric may be adjustedor incremented at 8400. In some embodiments, the vehicle operation riskmetric may be adjusted or incremented at 8400 for each information itemindicating risk tolerant vehicle operations identified at 8200. Forexample, for each of the identified temporally preceding vehicleoperation assistance information items that indicates the warningurgency the vehicle operation risk metric may be incremented by adefined value, such as one.

FIG. 9 is a diagram of determining a frequency metric in accordance withthis disclosure. In some embodiments, the frequency metric may representa measure of how often, how recently, or a combination of how often andhow recently, previously identified vehicle operation assistanceinformation similar to a current vehicle operation assistanceinformation item, such as the vehicle operation assistance informationidentified as shown at 4100 in FIG. 4, were identified. In someembodiments, determining the frequency metric at 9000 may be similar tothe frequency determination shown at 7700 in FIG. 7.

In some embodiments, determining a frequency metric at 9000 may includeidentifying a defined low frequency at 9100, identifying a set of recentsimilar spatially concurrent temporally preceding stored vehicleoperation assistance information items at 9200, determining acardinality of the set of recent similar spatially concurrent temporallypreceding stored vehicle operation assistance information items at 9300,determining per-period cardinalities for the set of recent similarspatially concurrent temporally preceding stored vehicle operationassistance information items at 9400, or a combination thereof.

In some embodiments, a frequency metric that indicates a low frequencymay be identified at 9100. A frequency metric that indicates a lowfrequency may indicate that previously identified vehicle operationassistance information similar to the current vehicle operationassistance information is unavailable. For example, the current vehicleoperation assistance information may indicate an expected status and thevehicle may not have previously traversed the current portion of thevehicle transportation network and a frequency metric that indicates alow frequency may be identified at 9100. In another example, the currentvehicle operation assistance information may indicate an abnormal statusand a frequency metric that indicates a low frequency may be identifiedat 9100.

In some embodiments, a set of spatially concurrent temporally precedingstored vehicle operation assistance information items may be identifiedat 9200. For example, multiple stored vehicle operation assistanceinformation items temporally preceding the current vehicle operationassistance information item may be identified, each of the storedvehicle operation assistance information items temporally preceding thecurrent vehicle operation assistance information item may indicate ageospatial location in the vehicle transportation network, and for eachof the stored vehicle operation assistance information items temporallypreceding the current vehicle operation assistance information item if adifference between a geospatial location in the vehicle transportationnetwork indicated by the current vehicle operation assistanceinformation and the respective geospatial location indicated by thestored temporally preceding vehicle operation assistance informationitem is within a defined geospatial threshold, the respective storedtemporally preceding vehicle operation assistance information item maybe identified as a spatially concurrent temporally preceding storedvehicle operation assistance information item. In some embodiments, eachspatially concurrent temporally preceding stored vehicle operationassistance information item that indicates similar vehicle operationassistance information to the current vehicle operation assistanceinformation item may be identified as a similar spatially concurrenttemporally preceding stored vehicle operation assistance informationitem. In some embodiments, each similar spatially concurrent temporallypreceding stored vehicle operation assistance information item mayindicate a temporal location, and each similar spatially concurrenttemporally preceding stored vehicle operation assistance informationitem that indicates a temporal location within a defined temporaldistance, such as a time period of one month, from a temporal locationindicated by the current vehicle operation assistance information may beincluded in a set of recent similar spatially concurrent temporallypreceding stored vehicle operation assistance information items.

In some embodiments, a cardinality of the set of recent similarspatially concurrent temporally preceding stored vehicle operationassistance information items may be identified at 9300. In someembodiments, the cardinality of the set of recent similar spatiallyconcurrent temporally preceding stored vehicle operation assistanceinformation items may indicate how often the corresponding vehicleoperation assistance information was presented to a driver of thevehicle in the preceding time period, which may indicate how familiarthe driver is with the vehicle transportation network conditionindicated by the vehicle operation assistance information. In someembodiments, the cardinality may be at least a frequency thresholddefined for the temporal distance and a frequency metric that indicatesa high frequency may be identified at 9310. For example, the temporaldistance may be one month, the cardinality may be three, the frequencythreshold defined for the one-month temporal distance may be 2, thecardinality may be at least the frequency threshold (3>=2), and afrequency metric that indicates a high frequency may be identified at9310.

In some embodiments, per-period cardinalities for the set of recentsimilar spatially concurrent temporally preceding stored vehicleoperation assistance information items may be determined at 9400.Determining the per-period cardinalities at 9400 may be similar todetermining the cardinality at 9300, except that the set of recentsimilar spatially concurrent temporally preceding stored vehicleoperation assistance information items may be grouped temporarily toidentify multiple sets of recent similar spatially concurrent temporallypreceding stored vehicle operation assistance information items, eachset corresponding to a respective time period, such as one week, in asequence, such as the weeks in a month. In some embodiments, acardinality of recent similar spatially concurrent temporally precedingstored vehicle operation assistance information items may be identifiedfor each period. In some embodiments, each period that has a cardinalityof recent similar spatially concurrent temporally preceding storedvehicle operation assistance information items that exceeds a frequencythreshold defined for the temporal distance of the period may beidentified as an active period. For example, each period may represent aweek, the frequency threshold defined per week may be one, and each weekthat includes at least one spatially concurrent temporally precedingstored vehicle operation assistance information item may be identifiedas an active week. In some embodiments, a cardinality of active weekswithin the temporal distance, which may include four week long periods,may be three, may be greater than an active period frequency thresholddefined for the temporal distance of the periods, and a frequency metricthat indicates a high frequency may be identified at 9410. For example,the temporal distance may include four week long periods, the frequencythreshold defined for each week may be one, three of the weeks mayinclude at least one recent similar spatially concurrent temporallypreceding stored vehicle operation assistance information item, theactive period frequency threshold may be three, the cardinality ofactive periods may be at least the active period frequency threshold(3>=3), and a frequency metric that indicates a high frequency may beidentified at 9410.

Identifying a frequency metric that indicates a high frequency at9310/9410 may indicate that the vehicle operation assistance informationis familiar and may suppress the use of familiar vehicle operationassistance information.

In some embodiments, the frequency may be associated with a driver ofthe vehicle. For example, a driver of the vehicle may be identifiedbased on a credential, such as a key fob, associated with the driver, orbased on a wireless electronic communication link, such as a Bluetoothlink, with a portable electronic device, such as a smartphone,associated with the driver, and the frequency may be determined based onstored information associated with the identified driver.

Although not shown separately in FIG. 9, in some embodiments, whethervehicle operation assistance information indicates an expected state oran abnormal state may be determined based on remote vehicle operationinformation, which may include information received from the remotevehicles, information generated based on sensor informationcorresponding to the remote vehicles, or a combination thereof. Forexample, remote vehicle operation information indicating erratic orurgent vehicle operations, such as vehicle operations exceeding definedremote vehicle operational parameters, which may be similar to theacceptability metrics, may indicate that the corresponding vehicleoperation assistance information indicates an abnormal state.

FIG. 10 is a diagram of presenting a representation of vehicle operationassistance information in accordance with this disclosure. In someembodiments, presenting a representation of vehicle operation assistanceinformation, such as the vehicle operation assistance informationidentified as shown at 4100 in FIG. 4, may include generating andoutputting one or more auditory representations of the vehicle operationassistance information, one or more visual, or graphical,representations of the vehicle operation assistance information, one ormore tactile representations of the vehicle operation assistanceinformation, or a combination thereof, for presentation to a driver, orother passenger, of the vehicle. In some embodiments, presenting arepresentation of vehicle operation assistance information 10000 may besimilar to the presenting shown at 4500 in FIG. 4.

In some embodiments, a vehicle, such as the vehicle 1000 shown in FIG.1, the vehicles 2100/2110 shown in FIG. 2, or the host vehicle 3200shown in FIG. 3, may present vehicle operation assistance informationvia one more user interface units, such as the user interface 1350 shownin FIG. 1. For example, a vehicle may include one or more graphicaldisplay portions, one or more audio presentation devises, or acombination of audio presentation devices and graphical displayportions, and vehicle operation assistance information may be presentedvia the user interface units, or a portion thereof. FIGS. 13-15 showdiagrams of examples of vehicles including graphical display portionsfor presenting vehicle operation assistance information.

In some embodiments, presenting a representation of vehicle operationassistance information at 10000 may include evaluating an urgency forthe vehicle operation assistance information at 10100, generating anaudio presentation at 10200, presenting the audio presentation at 10210,generating a graphical presentation at 10300, presenting a primaryportion of the graphical presentation at 10310, delaying at 10320,presenting a secondary portion of the graphical presentation at 10330,clearing the primary portion at 10340, generating a graphicalpresentation at 10400, presenting the graphical presentation at 10410,delaying at 10500, clearing the secondary portion at 10600, or acombination thereof.

In some embodiments, an urgency, such as the current urgency identifiedas shown at 4300 in FIG. 4 or as shown in FIG. 6, for vehicle operationassistance information, such as the vehicle operation assistanceinformation identified as shown at 4100 in FIG. 4, may be evaluated at10100.

In some embodiments, the vehicle operation assistance informationevaluated at 10100 may indicate a warning urgency or an advisory urgencyand an audible representation of the vehicle operation assistanceinformation may be generated at 10200 and presented at 10210. In someembodiments, generating audible representation of the vehicle operationassistance information may include evaluating the urgency. In someembodiments, the urgency for the vehicle operation assistanceinformation may indicate the advance urgency and generating the audiblerepresentation of the vehicle operation assistance information at 10200and presenting the audible representation of the vehicle operationassistance information at 10210 may be omitted. In some embodiments, theurgency for the vehicle operation assistance information may be theadvisory urgency and generating the audible representation of thevehicle operation assistance information at 10200 may includeidentifying an advisory audible representation of the vehicle operationassistance information, such as a soft chirp, beep, or chime, or a shortsequence thereof, such as two or three soft chimes. In some embodiments,the urgency for the vehicle operation assistance information may be thewarning urgency and generating the audible representation of the vehicleoperation assistance information at 10200 may include identifying awarning audible representation of the vehicle operation assistanceinformation, which may include an internal representation and anexternal representation. The warning internal audible representation maybe similar to the advisory audible representation, except that thewarning internal audible representation may be louder, longer, or both.For example, the advisory audible representation may include threerelatively quiet chimes and the warning internal audible representationmay include five relatively loud chimes. The external warning audiblerepresentation may include sounding a horn of the vehicle once or in aseries, such as two or three short beeps.

Although not shown separately in FIG. 10, in some embodiments, therepresentation of the vehicle operation assistance information, or aportion thereof, such as the audible representation, the graphicalrepresentation of the vehicle operation assistance information presentedvia the primary graphical display portion, the graphical representationof the vehicle operation assistance information presented via thesecondary graphical display portion, may be suppressed, omitted, orcleared, in response to input, such as user input clearing the vehicleoperation assistance information presentation or based on aconfiguration setting. In some embodiments, vehicle operation assistanceinformation management may include determining whether to present thevehicle operation assistance information using the primary graphicaldisplay portion, the secondary graphical display portion, the audiblepresentation device, one or more tactile presentation units, or acombination thereof. In some embodiments, presenting the vehicleoperation assistance information using the primary graphical displayportion, the secondary graphical display portion, the audiblepresentation device, one or more tactile presentation units, or acombination thereof, may include evaluating vehicle operation assistanceinformation presentation configuration settings. For example, thefrequency, or relative loudness of the audible presentation may bedetermined based on corresponding vehicle operation assistanceinformation presentation configuration settings.

In some embodiments, the vehicle operation assistance informationevaluated at 10100 may indicate a warning urgency or an advisory urgencyand a graphical, or visual, representation of the vehicle operationassistance information be identified or generated at 10300. Generating,or identifying, the graphical representation of the vehicle operationassistance information may include identifying, or generating, one ormore pictographic representations of the vehicle operation assistanceinformation, identifying one or more text representations of the vehicleoperation assistance information, identifying one or more verbaldescriptions of the vehicle operation assistance information, or acombination thereof. Examples of pictographic representation, textrepresentations, and verbal descriptions, of the vehicle operationassistance information are shown in FIG. 17.

In some embodiments, the graphical representation of the vehicleoperation assistance information may be presented via the primarygraphical display portion at 10310. In some embodiments, presenting thegraphical representation of the vehicle operation assistance informationvia the primary graphical display portion at 10310 may be similar theprimary presentation shown in FIG. 11.

In some embodiments, a primary delay timer, or other temporal delay, maybe initiated at 10320. For example, a primary delay timer may beinitiated at 10320 in response to, or in conjunction with, presentingthe graphical representation of the vehicle operation assistanceinformation via the primary graphical display portion at 10310.

In some embodiments, the graphical representation of the vehicleoperation assistance information may be presented via the secondarygraphical display portion at 10330. In some embodiments, the graphicalrepresentation of the vehicle operation assistance information may bepresented via the secondary graphical display portion at 10330 inresponse to detecting the primary delay timer initiated at 10320exceeding a defined secondary display delay, such as one second. In someembodiments, presenting the secondary portion at 10330 may be similarthe secondary presentation shown in FIG. 12.

In some embodiments, the primary portion may be cleared at 10340. Insome embodiments, the graphical representation of the vehicle operationassistance information presented via the primary graphical displayportion at 10310 may be cleared, or omitted from the primary graphicaldisplay portion, in response to an event, such as detecting the primarydelay timer initiated at 10320 exceeding a defined primary displayduration, such as three seconds, detecting that the vehicle traversedthe vehicle transportation network in accordance with the vehiclecontrol action, or otherwise determining that the vehicle operationassistance information is no longer relevant.

In some embodiments, the vehicle operation assistance informationevaluated at 10100 may indicate an advance urgency and a graphical, orvisual, representation of the vehicle operation assistance informationbe generated at 10400. Generating, or identifying, the graphicalrepresentation of the vehicle operation assistance information mayinclude identifying, or generating, one or more pictographicrepresentations of the vehicle operation assistance information,identifying one or more verbal descriptions of the vehicle operationassistance information, or a combination thereof. Examples ofpictographic representation, text representations, and verbaldescriptions, of the vehicle operation assistance information are shownin FIG. 17.

In some embodiments, the graphical representation of the vehicleoperation assistance information may be presented via the secondarygraphical display portion at 10410. In some embodiments, presenting therepresentation at 10410 may be similar the secondary presentation shownin FIG. 12.

In some embodiments, a secondary delay timer, or other temporal delay,may be initiated at 10500. For example, a secondary delay timer may beinitiated at 10500 in response to, or in conjunction with, presentingthe graphical representation of the vehicle operation assistanceinformation via the secondary graphical display portion 10330/10410.

In some embodiments, the secondary portion may be cleared at 10600. Insome embodiments, the graphical representation of the vehicle operationassistance information presented via the secondary graphical displayportion at 10330/10410 may be cleared, or omitted from the primarygraphical display portion, in response to an event, such as detectingthe secondary delay timer initiated at 10500 exceeding a definedsecondary display duration, such as five seconds, detecting that thevehicle traversed the vehicle transportation network in accordance withthe vehicle control action, or otherwise determining that the vehicleoperation assistance information is no longer relevant.

Although not shown separately in FIG. 10, in some embodiments,presentations representing defined vehicle operation assistanceinformation may be generated, or identified, and presented in responseto input, such as user input selecting the presentations, such that auser, such as a driver of the vehicle, may review, configure, or both,the presentations representing vehicle operation assistance information.

FIG. 11 is a diagram of presenting a graphical representation of thevehicle operation assistance information via a primary graphical displayportion in accordance with this disclosure. In some embodiments,presenting a graphical representation of the vehicle operationassistance information presented via a primary graphical display portion11000 may be similar to the primary presenting shown at 10310 in FIG.10.

In some embodiments, presenting the graphical representation of thevehicle operation assistance information via the primary graphicaldisplay portion at 11300 may include identifying a current presentationstatus for the primary graphical display portion at 11400, evaluatingthe urgency at 11410, clearing the primary graphical display portion, ora portion thereof at 11412/11414, displaying a portion of the graphicalrepresentation of the vehicle operation assistance information presentedvia the primary graphical display portion at 11500, identifying acurrent presentation status for the secondary graphical display portionat 11510, evaluating the urgency at 11520, clearing the primarygraphical display portion, or a portion thereof at 11522/11524, or acombination thereof.

In some embodiments, identifying the current presentation status for theprimary graphical display portion at 11400 may include determiningwhether the primary graphical display portion is currently displayinginformation, such as other vehicle operation assistance information,navigation information, or other information, such as non-vehicleoperation assistance information.

In some embodiments, the current presentation status for the primarygraphical display portion may indicate that the primary graphicaldisplay portion is displaying information, and the urgency may beevaluated at 11410. In some embodiments, the urgency may indicate awarning urgency and the primary graphical display portion may be clearedat 11412. In some embodiments, the urgency may indicate an advisoryurgency, the current presentation status for the primary graphicaldisplay portion may indicate that the primary graphical display portionis displaying other information, such as non-vehicle operationassistance information, and the other information may be cleared at11414. In some embodiments, the urgency may indicate an advisoryurgency, the current presentation status for the primary graphicaldisplay portion may indicate that the primary graphical display portionis displaying navigation information, and the navigation information maybe cleared at 11414. In some embodiments, clearing the navigationinformation at 11414 may be omitted.

In some embodiments, the current presentation status for the primarygraphical display portion may indicate that the primary graphicaldisplay portion is not displaying information, and evaluating theurgency at 11410 and clearing the primary graphical display portion, ora portion thereof at 11412/11414 may be omitted.

In some embodiments, a portion of the graphical representation of thevehicle operation assistance information may be presented via theprimary graphical display portion at 11500. In some embodiments,presenting the graphical representation of the vehicle operationassistance information via the primary graphical display portion at11500 may include presenting a first portion of the graphicalrepresentation of the vehicle operation assistance information, such asthe portion shown at 17140 in FIG. 17, which may include a largepictographic representation of the vehicle operation assistanceinformation, such as the large pictographic representation shown at17112/17114 in FIG. 17, and a text representation of the vehicleoperation assistance information, such as the text representation shownat 17120 in FIG. 17. In some embodiments, the current presentationstatus for the primary graphical display portion may indicate that theprimary graphical display portion is displaying navigation informationand presenting the graphical representation of the vehicle operationassistance information via the primary graphical display portion at11500 may include combining a portion of the graphical representation ofthe vehicle operation assistance information with the representation ofthe navigation information, and presenting the combined representation.

In some embodiments, a current presentation status for the secondarygraphical display portion may be identified at 11510. In someembodiments, identifying the current presentation status for thesecondary graphical display portion at 11510 may include determiningwhether the secondary graphical display portion is currently displayinginformation, such as other vehicle operation assistance information,navigation information, or other information, such as non-vehicleoperation assistance information.

In some embodiments, the urgency may be evaluated at 11520. In someembodiments, the urgency may indicate a warning urgency and thesecondary graphical display portion may be cleared at 11522. In someembodiments, the urgency may indicate an advisory urgency, the currentpresentation status for the secondary graphical display portion mayindicate that the secondary graphical display portion is displayingother information, such as non-vehicle operation assistance information,and the other information may be cleared at 11524. In some embodiments,the urgency may indicate an advisory urgency, the current presentationstatus for the secondary graphical display portion may indicate that thesecondary graphical display portion is displaying navigationinformation, and the navigation information may be cleared at 11524. Insome embodiments, clearing the navigation information at 11524 may beomitted.

In some embodiments, the current presentation status for the secondarygraphical display portion may indicate that the secondary graphicaldisplay portion is not displaying information, and evaluating theurgency at 11520 and clearing the secondary graphical display portion,or a portion thereof at 11522/11524 may be omitted.

FIG. 12 is a diagram of presenting a graphical representation of thevehicle operation assistance information via a secondary graphicaldisplay portion in accordance with this disclosure. In some embodiments,presenting a secondary portion of a representation of vehicle operationassistance information 12000 may be similar to the secondary presentingshown at 10330/10410 in FIG. 10.

In some embodiments, presenting the graphical representation of thevehicle operation assistance information via the secondary graphicaldisplay portion at 12000 may include identifying a current presentationstatus for the secondary graphical display portion at 12100, evaluatingthe urgency at 12110, clearing the secondary graphical display portion,or a portion thereof at 12112/12114, displaying a portion of thegraphical representation of the vehicle operation assistance informationpresented via the secondary graphical display portion at 12200, or acombination thereof.

In some embodiments, identifying the current presentation status for thesecondary graphical display portion at 12100 may include determiningwhether the secondary graphical display portion is currently displayinginformation, such as other vehicle operation assistance information,navigation information, or other information, such as non-vehicleoperation assistance information.

In some embodiments, the current presentation status for the secondarygraphical display portion may indicate that the secondary graphicaldisplay portion is displaying information, and the urgency may beevaluated at 12110. In some embodiments, the urgency may indicate awarning urgency and the secondary graphical display portion may becleared at 12112. In some embodiments, the urgency may indicate anadvisory urgency or an advance urgency, the current presentation statusfor the secondary graphical display portion may indicate that thesecondary graphical display portion is displaying other information,such as non-vehicle operation assistance information, and the otherinformation may be cleared at 12114. In some embodiments, the urgencymay indicate an advisory urgency or an advance urgency, the currentpresentation status for the secondary graphical display portion mayindicate that the secondary graphical display portion is displayingnavigation information, and the navigation information may be cleared at12114. In some embodiments, clearing the navigation information at 12114may be omitted.

In some embodiments, the current presentation status for the secondarygraphical display portion may indicate that the secondary graphicaldisplay portion is not displaying information, and evaluating theurgency at 12110 and clearing the secondary graphical display portion,or a portion thereof at 12112/12114 may be omitted.

In some embodiments, a portion of the graphical representation of thevehicle operation assistance information may be presented via thesecondary graphical display portion at 12200. In some embodiments,presenting the graphical representation of the vehicle operationassistance information via the secondary graphical display portion at12200 may include presenting a second portion of the graphicalrepresentation of the vehicle operation assistance information, such asthe portion shown at 14150 in FIG. 17, which may include a smallpictographic representation of the vehicle operation assistanceinformation, such as the small pictographic representation shown at17116/17118 in FIG. 17, and a verbal description of the vehicleoperation assistance information, such as the verbal description shownat 17130 in FIG. 17. In some embodiments, the current presentationstatus for the secondary graphical display portion may indicate that thesecondary graphical display portion is displaying navigation informationand presenting the graphical representation of the vehicle operationassistance information via the secondary graphical display portion at12200 may include combining a portion of the graphical representation ofthe vehicle operation assistance information with the representation ofthe navigation information, and presenting the combined representation.

FIGS. 13-16 show diagrams of portions of a front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure. The examples shown inFIGS. 13-16 include graphical display portions; however, although notshown in FIGS. 13-16, a vehicle may include other elements for use invehicle operation assistance information management, such as one or moreinterior auditory presentation devices, one or more exterior auditorypresentation devices, one or more tactile presentation units, one ormore exterior visual presentation devices, or a combination thereof.

In some embodiments, the passenger compartment of a vehicle may includeone or more interior auditory presentation devices, such as speakers,which may, individually, or in combination, present audible information,such as the audible presentation shown at 10210 in FIG. 10, for use invehicle operation assistance information management. For example, one ormore speakers may audibly present a chime or beep, or a series thereof,representing or indicating vehicle operation assistance information. Insome embodiments, the vehicle may include a dedicated vehicle operationassistance information auditory presentation device, which may belocated proximate to the primary display portion.

In some embodiments, the vehicle may include one or more externalauditory presentation devices, such as a horn, which may, individually,or in combination, present audible information, such as the audiblepresentation shown at 10210 in FIG. 10, for use in vehicle operationassistance information management. For example, the horn may sound oneor more times, representing or indicating vehicle operation assistanceinformation.

In some embodiments, the vehicle may include one or more tactile userinterface units, such as a haptic feedback unit, which may,individually, or in combination, present tactile information for use invehicle operation assistance information management. For example, thevehicle may include a seat, which may include a tactile user interfaceunit, which may vibrate one or more times, representing or indicatingvehicle operation assistance information. In another example, thevehicle may include a steering wheel that may include a left sidetactile user interface unit and a right side tactile user interfaceunit. The left side tactile user interface unit may present tactileinformation corresponding to vehicle operation assistance information tothe left of the vehicle, the right side tactile user interface unit maypresent tactile information corresponding to vehicle operationassistance information to the right of the vehicle, and both tactileuser interface units may present tactile information corresponding tovehicle operation assistance information ahead of the vehicle. Inanother example, a pedal, such as an acceleration pedal, may include atactile user interface unit, which may present tactile informationcorresponding to vehicle operation assistance information.

In some embodiments, the vehicle may include one or more exterior visualpresentation units, such as headlights, which may, individually, or incombination, externally present visual information for use in vehicleoperation assistance information management. For example, the headlightsmay flash one or more times, representing or indicating vehicleoperation assistance information.

In some embodiments, presenting vehicle operation assistance informationmay include presenting the vehicle operation assistance informationusing a combination of the user interface units. For example, thevehicle operation assistance information may indicate a potential frontimpact collision warning, and presenting the vehicle operationassistance information may include contemporaneously sounding the horn,playing a sequence of beeps via the speakers, vibrating the seat,flashing the headlights, and displaying a graphical representation ofthe vehicle operation assistance information via a primary graphicaldisplay portion.

In some embodiments, the graphical display portions may graphically, orvisually, present information, such as vehicle operation assistanceinformation, navigation information, or other information, which mayinclude audio system information, systems information, or any otherinformation other than vehicle operation assistance information andnavigation information. In some embodiments, one or more of thegraphical display portions may be a dedicated primary graphical displayportion. A dedicated primary graphical display portion may omitpresenting information other than vehicle operation assistanceinformation.

In some embodiments, a vehicle may include one or more tertiarygraphical or visual display portions and vehicle operation assistanceinformation management may include omitting presenting vehicle operationassistance information via the tertiary graphical or visual displayportions, which may reduce driver confusion or distraction.

Although example configurations of portions of a front of a passengercompartment of a vehicle are shown in FIGS. 13-16; any alignment,positioning, or configuration of any of the elements shown in FIGS.13-16, or otherwise described herein, may be used. In some embodiments,vehicle operation assistance information management may includepositioning the graphical display portions within the vehicle as shownin FIG. 16.

FIG. 13 is a diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure. In some embodiments, avehicle, such as the vehicle 1000 shown in FIG. 1 or the vehicles2100/2110 shown in FIG. 2, may include an instrument panel 13100, awindshield 13200, or a combination thereof.

In some embodiments, the instrument panel 13100 may include a steeringwheel 13110, a meter cluster 13120, a center console 13130, or acombination thereof.

In some embodiments, the steering wheel 13110 may extend from theinstrument panel 13100 along a center column (not shown), and mayinclude steering wheel controls (not expressly shown). In someembodiments, the steering wheel 13110 may include one or more userinterface units (not shown), such as one or more tactile user interfaceunits, one or more speakers, one or more graphical display units, or acombination thereof.

In some embodiments, the meter cluster 13120 may include one or moremeters or gauges 13122, such as a speedometer or a tachometer. In someembodiments, the meter cluster 13120 may include one or more graphicaldisplay portions 13124/13126. For example, the graphical display portion13126 at the top of the meter cluster 13120 may be a primary graphicaldisplay portion, and the graphical display portion 13124 at the bottomof the meter cluster 13120 may be a secondary graphical display portion.In another example, the graphical display portion 13124 at the bottom ofthe meter cluster 13120 may be omitted. In another example, thegraphical display portion 13126 at the top of the meter cluster 13120may be omitted and the graphical display portion 13124 at the bottom ofthe meter cluster 13120 may be may be a primary graphical displayportion.

In some embodiments, the graphical display portion 13126 at the top ofthe meter cluster 13120 and the graphical display portion 13124 at thebottom of the meter cluster 13120 may be included in a single physicalgraphical display unit. In some embodiments, the graphical displayportion 13126 at the top of the meter cluster 13120 may be included in afirst physical graphical display unit and the graphical display portion13124 at the bottom of the meter cluster 13120 may be included in asecond physical graphical display unit.

In some embodiments, the center console 13130 may include one or moregraphical display portions 13132. For example, the meter cluster 13120may include the primary graphical display portion 13126 at the top ofthe meter cluster 13120 and the center console 13130 may include thesecondary graphical display portion 13132. In another example, the metercluster 13120 may include the primary graphical display portion 13124 atthe bottom of the meter cluster 13120 and the center console 13130 mayinclude the secondary graphical display portion 13132.

In some embodiments, the windshield 13200 may include a graphicaldisplay portion 13210. For example, the windshield 13200 may include aprimary graphical display portion, a secondary graphical displayportion, or both. In some embodiments, the graphical display portion13210 included in the windshield 13200 may be a heads-up, or augmentedreality display. In some embodiments, the windshield 13200 may includethe graphical display portion 13210 in a translucent physical graphicaldisplay device. In some embodiments, the graphical display portion 13210may be projected on the windshield by a projector device (not separatelyshown), which may be physically separate from the windshield.

FIG. 14 is another diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure. The example shown in FIG.14 may be similar to the example shown in FIG. 13, except that the metercluster 14100 may omit the primary graphical display portion and thesecondary graphical display portion, and the heads-up display 14200 mayinclude a primary graphical display portion 14210 and a secondarygraphical display portion 14220. In some embodiments, the center consolegraphical display unit 14300 may omit the primary graphical displayportion and the secondary graphical display portion. In another example,the heads-up display 14200 may include the primary graphical displayportion 14210 and omit the secondary graphical display portion 14220,and the center console graphical display unit 14300 may include thesecondary graphical display portion.

FIG. 15 is another diagram of a portion of the front of a passengercompartment of a vehicle for vehicle operation assistance informationmanagement in accordance with this disclosure. The example shown in FIG.15 may be similar to the example shown in FIG. 13, except as describedherein.

In some embodiments, the vehicle may include a primary graphical displayportion 15100 in a meter cluster aligned with the steering wheel, andmay include a secondary graphical display portion 15200 in a centerconsole adjacent to the steering wheel. As shown on the left, theprimary graphical display portion 15100A may include one or more virtualmeters 15110/15120/15130 and may omit vehicle operation assistanceinformation. Vehicle operation assistance information management mayinclude controlling the primary graphical display portion 15100 and thesecondary graphical display portion 15200 to display vehicle operationassistance information.

For example, vehicle operation assistance information management mayinclude controlling the graphical display unit in the meter cluster15100A to display the meters 15110/15120/15130. Subsequently, vehicleoperation assistance information management may include identifyingvehicle operation assistance information, as shown at 4100 in FIG. 4.Vehicle operation assistance information management may includedetermining an urgency for the vehicle operation assistance information,as shown at 4300 in FIG. 4 or as shown in FIG. 6. The urgency may be theadvance urgency and vehicle operation assistance information managementmay include controlling the secondary graphical display portion 15200 topresent a graphical representation of the vehicle operation assistanceinformation.

In another example, as shown at the top-right, vehicle operationassistance information management may include identifying the urgency asthe advisory urgency or the warning urgency, and may control the primarygraphical display portion 15100B to omit one or more of the meters15110/15120/15130, such as the center meter 15110 as shown, and presenta portion 15140 of the graphical representation of the vehicle operationassistance information. Vehicle operation assistance informationmanagement may include controlling the secondary graphical displayportion 15200 to present a second portion of the graphicalrepresentation of the vehicle operation assistance information.

In another example, as shown at the bottom-right, vehicle operationassistance information management may include identifying the urgency asthe advisory urgency or the warning urgency, and may control the primarygraphical display portion 15100C to omit the meters 15110/15120/15130and present a portion 15150 of the graphical representation of thevehicle operation assistance information. Vehicle operation assistanceinformation management may include controlling the secondary graphicaldisplay portion 15200 to present a second portion of the graphicalrepresentation of the vehicle operation assistance information.

In another example, vehicle operation assistance information managementmay include controlling the primary graphical display portion to presentadvisory vehicle operation assistance information as shown at thetop-right 15100B, and may control the primary graphical display portionto present warning vehicle operation assistance information as shown atthe bottom-right 15100B.

In some embodiments, the primary display portion, the secondary displayportion, or both, may be configured to provide the appearance of depthsuch that displayed elements may be displayed such that some elementsappear closer or further away in the same display portion. For example,the primary display portion, the secondary display portion, or both, maybe included in a physical display device, which may be athin-film-transistor (TFT) display device. In some embodiments, clearingthe primary display portion, the secondary display portion, or both, mayinclude showing other information as further away and showing thevehicle operation assistance information as closer to the observer.

FIG. 16 is a diagram of positioning vehicle operation assistanceinformation graphical presentations within a vehicle in accordance withthis disclosure. In some embodiments, a driver 16000 of a vehicle 16100may have a primary field of view 16200. The primary field of view 16200may have a center 16210, which may correspond with focal point for thedriver 16000.

In some embodiments, positioning vehicle operation assistanceinformation graphical presentations within a vehicle 16100 may includespatially locating a primary graphical display portion, which isindicated by a white diamond 16300 in FIG. 16, in the vehicle 16100along a defined primary angular offset 16400 from the center 16210 ofthe field of view 16200 of the driver 16000.

In some embodiments, positioning vehicle operation assistanceinformation graphical presentations within a vehicle 16100 may includespatially locating a secondary graphical display portion, which isindicated by a stippled diamond 16500 in FIG. 16, in the vehicle 16100along a defined secondary angular offset from the center 16210 of thefield of view 16200 of the driver 16000. In some embodiments, the secondangular offset may be substantially greater than the first angularoffset 16400, so that the primary graphical display portion 16300 isvisually distinct from the secondary graphical display portion 16500.

Although not shown in FIG. 16, spatially locating the primary andsecondary graphical display portions may include identifying a visualdepth for the primary graphical display portion, which may indicate anapparent spatial distance from the observer, such as the driver of thevehicle, to the primary graphical display portion, identifying a visualdepth for the secondary graphical display portion, which may indicate anapparent spatial distance from the observer, such as the driver of thevehicle, to the secondary graphical display portion, or identifying thevisual depth for the primary graphical display portion and the visualdepth for the secondary graphical display portion. For example, thevisual depth for the primary graphical display portion may be identifiedas more proximal than the visual depth for the secondary graphicaldisplay portion, such that the primary graphical display portion isvisually distinct from the secondary graphical display portion.

FIG. 17 shows examples of a graphical representation of vehicleoperation assistance information in accordance with this disclosure. Insome embodiments, presenting a representation 17100 of the vehicleoperation assistance information, such as the presenting shown at 10000in FIG. 10, may include identifying, or generating, one or morepictographic representations 17112/17114/17116/17118 of the vehicleoperation assistance information, identifying one or more textrepresentations 17120 of the vehicle operation assistance information,identifying one or more verbal descriptions 17130 of the vehicleoperation assistance information, or a combination thereof. For example,the pictographic representations 17112/17114/17116/17118, the textrepresentations 17120, the verbal descriptions 17130, or a combinationthereof may be identified based on vehicle operation assistanceinformation type information, such as the vehicle operation assistanceinformation type identified as shown at 4100 in FIG. 4.

In some embodiments, a pictographic representation17112/17114/17116/17118 of vehicle operation assistance information maybe similar to an icon, and may include a simple, easily recognizable,representation of the vehicle operation assistance information. Forexample, the vehicle operation assistance information may indicate aforward collision warning, and the pictographic representation mayinclude two red circles 17112/17114 or 17116/17118, each of which mayinclude an ‘X’. In some embodiments, the red ‘X’ circles may oscillate,such as in size, color, or brightness, as indicated by the darkstippling on the left at 17112/17116 and the light stippling on theright at 17114/17118. In some embodiments, a primary portion of therepresentation may include a relatively large version of thepictographic representation 17112/17114, and a secondary portion mayinclude a relatively small version 17116/17118. In some embodiments, thelarge version of the pictographic representation 17112/17114 mayoscillate, and the small version 17116/17118 may omit oscillation.

In some embodiments, a text representation 17116 of the vehicleoperation assistance information may include a single word, such as‘STOP!’, ‘WAIT!’, ‘AHEAD!’, or ‘GO!’, or a short phrase, such as ‘25MPH!’. In some embodiments, a verbal description 17130 of the vehicleoperation assistance information may explain or confirm the meaning ofthe pictographic representation 17112/17114/17116/17118, which mayinclude an explanation of the vehicle operation assistance information.

In some embodiments, vehicle operation assistance information managementmay include presenting the representation 17110 of the vehicle operationassistance information, which may include controlling the primarygraphical display portion to present a first portion 17140 of thegraphical representation, which may include the large pictographicrepresentation 17112/17114 and the text representation 17120. In someembodiments, vehicle operation assistance information management mayinclude presenting the representation 17110 of the vehicle operationassistance information, which may include controlling the secondarygraphical display portion to present a second portion 17150 of thegraphical representation, which may include the small pictographicrepresentation 17116/17118 and the verbal description 17130.

In some embodiments, generating or identifying a graphicalrepresentation of vehicle operation assistance information may includeincluding visual elements that indicate an association between theelements representing the vehicle operation assistance information. Forexample, the pictographic representation shown on the left 17112/17114is visually similar to the pictographic representation shown in thecenter 17116/17118, which may indicate an association between therepresentations.

In some embodiments, the representation of a vehicle operationassistance information item may be identified or generated based on theurgency identified for the vehicle operation assistance information. Insome embodiments, the visual elements representing the vehicle operationassistance information, such as the pictographic representation, thetext representation, or the verbal description, may depend on theurgency associated with the vehicle operation assistance informationitem. In some embodiments, other display elements, such as a displaybackground or a boarder around a portion, such as the portion includedin the primary graphical display portion, may depend on the urgencyassociated with the vehicle operation assistance information.

For example, a vehicle operation assistance information item may beidentified as an advance urgency vehicle operation assistanceinformation item, and portion of the representation shown on the left17140 may be omitted. In another example, the urgency for the vehicleoperation assistance information item may be identified as advisory, andthe representation shown at 17100 may be used. In another example, theurgency for the vehicle operation assistance information item may beidentified as a warning urgency, and the representation shown on theleft at 17140 may be adjusted to indicate the warning urgency, such asby increasing the size, changing a background color, or adding a boarderaround the portion, such as a thick red boarder.

In another example, the vehicle operation assistance information mayindicate that the vehicle is approaching a curve associated with a speedlimit that is substantially lower, such as 20 miles per hour lower, thana current speed of the vehicle. The vehicle may be relatively far awayfrom the location of the curve in the vehicle transportation network,and the vehicle operation assistance information item may be identifiedas having an advance urgency. A graphical representation, which may besimilar to the portion shown on the right 17150, may be generated oridentified. The graphical representation may include a relatively smallpictographic representation, such as a diamond shaped icon having ayellow background, a black boarder, and a thick black left bendingarrow. The graphical representation may include an informative verbaldescription, such as “Curve ahead.” The vehicle operation assistanceinformation may be identified as having an advisory urgency, and asimilar graphical representation may be generated or identified. Theadvisory graphical representation may include a relatively largepictographic representation, a text representation, a relatively smallpictographic representation, and an instructive verbal description. Thepictographic representations may be similar to the pictographicrepresentation identified for the advance urgency, the textrepresentation may indicate the identified speed, such as “25 mph”, andthe verbal description may be informative and instructive, such as“Curve ahead, reduce speed.” The vehicle operation assistanceinformation may be identified as having a warning urgency, and a similargraphical representation may be generated or identified. The warninggraphical representation may include the relatively large pictographicrepresentation with highlighting, such as a bright red boarder. The textrepresentation may indicate a heightened imperative, such as byincluding an exclamation mark, “25 mph!”, and the verbal description maybe instructive and imperative, such as “At curve, reduce speed now!”.

FIG. 18 is a diagram of vehicle operation assistance informationmanagement for autonomous vehicle control operation in accordance withthis disclosure. In some embodiments, vehicle operation assistanceinformation management for autonomous vehicle control operation may beimplemented in a vehicle, such as the vehicle 1000 shown in FIG. 1, thevehicles 2100/2110 shown in FIG. 2, or the host vehicle 3200 shown inFIG. 3. In some embodiments, vehicle operation assistance informationmanagement for autonomous vehicle control operation may be similar tovehicle operation assistance information management, such as the vehicleoperation assistance information management shown in FIG. 4, except asdescribed herein.

In some embodiments, vehicle operation assistance information managementfor autonomous vehicle control operation may include traversing aportion of a vehicle transportation network at 18000, identifying avehicle operation assistance information item at 18100, identifying animmanency for the vehicle operation assistance information item at18200, determining an urgency at 18300; utilizing the vehicle operationassistance information item at 18400, traversing another portion of avehicle transportation network at 18500, storing informationrepresenting the vehicle operation assistance information item at 18600,or a combination thereof.

In some embodiments, vehicle operation assistance information may beidentified at 18100. For example, identifying vehicle operationassistance information may include receiving the vehicle operationassistance information from a source external to the vehicle, or from asource internal to the vehicle, or generating the vehicle operationassistance information in response to information received from a sourceexternal to the vehicle or a source internal to the vehicle. Forexample, vehicle operation assistance information may be generated basedon vehicle operation assistance information stored in a memory of thevehicle. In some embodiments, identifying vehicle operation assistanceinformation at 18100 may be similar to identifying vehicle operationassistance information as shown at 4100 in FIG. 4, except as describedherein.

In some embodiments, identifying vehicle operation assistanceinformation at 18100 may include receiving information indicating avehicle operation control transfer request, such as a driver initiatedvehicle operation control transfer request or a vehicle initiatedvehicle operation control transfer request. In some embodiments, avehicle operation control transfer indicated by a vehicle operationcontrol transfer request may be an expected vehicle operation controltransfer.

In some embodiments, identifying vehicle operation assistanceinformation at 18100 may include receiving information indicating avehicle operation control transfer request that includes a driverinitiated vehicle operation control transfer request. For example, adriver may be operating the vehicle, or the vehicle may be stationary,such as parked, and the driver may initiate, or request, a transfer ofcontrol of the vehicle from driver control to autonomous vehiclecontrol, such as control by an autonomous vehicle control unit. Inanother example, an autonomous vehicle control unit may be operating thevehicle, and a driver may initiate, or request, a transfer of control ofthe vehicle from autonomous vehicle control to driver control.

In some embodiments, identifying vehicle operation assistanceinformation at 18100 may include identifying information indicating avehicle operation control transfer request that includes a vehicleinitiated vehicle operation control transfer request. For example, anautonomous vehicle control unit may be operating the vehicle, and theautonomous vehicle control unit may initiate, or request, a transfer ofcontrol of the vehicle from autonomous vehicle control to drivercontrol. In another example, a driver may be operating the vehicle, andthe autonomous vehicle control unit may initiate, or request, a transferof control of the vehicle from driver control to autonomous vehiclecontrol.

In some embodiments, the autonomous vehicle control unit may initiate,or request, a transfer of control of the vehicle in response toidentifying vehicle transportation network information representing aportion of a vehicle transportation network, such as vehicletransportation network information identified in response to traversinga portion of the vehicle transportation network. For example, theautonomous vehicle control unit may be operating the vehicle, such as inaccordance with a route, the autonomous vehicle control unit maydetermine that the route includes a portion that the autonomous vehiclecontrol unit identifies as a driver control portion, and the autonomousvehicle control unit may initiate, or request, a transfer of control ofthe vehicle from autonomous vehicle control to driver control.

In some embodiments, the autonomous vehicle control unit may initiate,or request, a transfer of control of the vehicle in response toreceiving external vehicle operation assistance information, such as viaa wireless electronic communication link. In some embodiments, theautonomous vehicle control unit may initiate, or request, a transfer ofcontrol of the vehicle in response to receiving sensor information froma sensor of the vehicle, such as the sensor 1360 shown in FIG. 1.

In some embodiments, identifying vehicle operation assistanceinformation at 18100 may include receiving information indicating acandidate vehicle control operation, such as a lane change, turning froma current road to another road, an acceleration, a deceleration,parking, or any other autonomous vehicle maneuver. For example, thevehicle may traverse a portion of a vehicle transportation network inaccordance with a defined route from an origin to a destination; theroute may include a turn from a road to another road, and the vehicleoperation assistance information may include an indication of the turnas a candidate vehicle control operation.

In some embodiments, the vehicle operation assistance information mayinclude an indication of a candidate vehicle control operationidentified based on a current operational environment of the vehicle. Insome embodiments, a candidate vehicle control operation may be anautonomous vehicle control operation. For example, the vehicle maytraverse a portion of a vehicle transportation network in a lane,vehicle operation assistance information may be identified based oninformation indicating that a cost for traversing the current portion ofthe vehicle transportation network via a current lane exceeds a cost fortraversing the current portion of the vehicle transportation network viaanother current lane, such as an adjacent lane, and the vehicleoperation assistance information may include an indication of a lanechange as a candidate vehicle control operation.

In some embodiments, the vehicle operation assistance information mayinclude an indication of a candidate vehicle control operationidentified based on information received from a source external to thevehicle, such as information received from another vehicle orinformation received from an infrastructure unit of the vehicletransportation network. In some embodiments, vehicle operationassistance information received from a source external to the vehiclemay include a recommended speed profile, such as an indication of arecommended speed for traversing the vehicle transportation network inaccordance with expected permitted right-of-way signal information for atraffic control device of the vehicle transportation network. Forexample, a recommended speed profile may indicate an increase in speed,such as an increase of five miles per hour, to allow the vehicle toarrive at an intersection concurrently with a green signal, or arecommended speed profile for accelerating from a stationary state at ared light. In some embodiments, a vehicle may generate a recommendedspeed profile based on information, such as traffic control device stateinformation.

In some embodiments, the vehicle operation assistance information mayinclude an indication of a candidate vehicle control operationidentified in response to driver input, such as a driver initiatedvehicle operation parking assistance request.

In some embodiments, an immanency for the vehicle operation assistanceinformation item may be determined at 18200. In some embodiments, theimmanency may indicate temporal cost, which may indicate a temporal orspatial distance, for the vehicle to traverse the vehicle transportationnetwork from a current geospatial location in the vehicle transportationnetwork to a target geospatial location indicated by the vehicleoperation assistance information. In some embodiments, the vehicleoperation assistance information may indicate a portion of the vehicletransportation network, such as a driver control portion, and thegeospatial location indicated by the vehicle operation assistanceinformation may correspond with a geospatial location of the portion ofthe vehicle transportation network indicated by the vehicle operationassistance information proximal to the vehicle. In some embodiments,determining an immanency for the vehicle operation assistanceinformation item at 18200 may be similar to the immanency determinationshown at 4200 in FIG. 4, the immanency determination shown in FIG. 5, orthe immanency determination shown in FIG. 19.

In some embodiments, determining the immanency at 18200 may includedetermining whether the immanency exceeds, or is greater than, a maximumrelevant immanence, which may be a defined maximum relevant immanence ora calculated maximum relevant immanence. For example, the maximumrelevant immanence may indicate a temporal period, such as one minute,and determining the immanency at 18200 may include determining whetherthe immanency is greater than one minute. In some embodiments, theimmanency may be greater than the maximum relevant immanence,information representing the vehicle operation assistance informationidentified at 18200 may be stored at 18600, and one or more elements ofvehicle operation assistance information management for autonomousvehicle control operation, such as determining an urgency at 18300, orutilizing the vehicle operation assistance information item at 18400,may be omitted.

In some embodiments, an urgency for the vehicle operation assistanceinformation item may be determined at 18300. In some embodiments, theurgency may represent a measure of the temporal or spatial distanceavailable for utilizing the vehicle operation assistance information totraverse the vehicle transportation network. For example, the vehicleoperation assistance information may indicate that a current route forthe vehicle includes a driver control portion, and the urgency mayindicate a temporal distance available for utilizing the vehicleoperation assistance information to complete a vehicle control transfer,such as by presenting information to the driver of the vehicle, whichmay include information representative of the condition, event, orprobable event, and may include instructions for transferring control ofthe vehicle, operating the vehicle, or both. In some embodiments,determining an urgency at 18300 may be similar to the urgencydetermination shown at 4300 in FIG. 4, the urgency determination shownin FIG. 6, or the urgency determination shown in FIG. 20.

Although not shown in FIG. 18, in some embodiments, a utility metric forthe vehicle operation assistance information item may be determined. Insome embodiments, the utility metric may indicate a value of the vehicleoperation assistance information relative to current operatingcharacteristics for the vehicle. In some embodiments, determining theutility metric for the vehicle operation assistance information item maybe similar to the utility metric determination shown at 4400 in FIG. 4or the utility metric determination shown in FIG. 7.

In some embodiments, the vehicle operation assistance information may beutilized at 18400. For example, utilizing the vehicle operationassistance information at 18400 may include presenting a representationof the vehicle operation assistance information, storing the vehicleoperation assistance information, transmitting the vehicle operationassistance information to an external device, controlling one or moreoperations of the vehicle, or a combination thereof. Transmitting thevehicle operation assistance information may include transmitting aportion of the vehicle operation assistance information, relatedinformation, or a combination thereof.

In some embodiments, utilizing the vehicle operation assistanceinformation at 18400 may include transferring vehicle control, such asfrom autonomous vehicle control to driver control, or from drivercontrol to autonomous vehicle control. In some embodiments, utilizingthe vehicle operation assistance information at 18400 may includecontrolling the vehicle in accordance with a primary vehicle controlaction or a secondary vehicle control action. For example, the vehicleoperation assistance information may indicate a vehicle operationcontrol transfer, the primary vehicle control action may be the vehicleoperation control transfer and the secondary vehicle control action maybe a safety action, such as safely stopping the vehicle. In someembodiments, utilizing the vehicle operation assistance information at18400 may be similar to the utilization shown in FIG. 21.

In some embodiments, the vehicle may traverse another portion of avehicle transportation network at 18500. For example, the vehicle maytraverse the vehicle transportation network at 18500 based on thevehicle operation assistance information. In some embodiments,traversing another portion of the vehicle transportation network at18500 may include storing information representing the vehicle operationassistance information at 18600.

In some embodiments, information representing the vehicle operationassistance information item may be stored at 18600, which may be similarto the information storage shown at 4700 in FIG. 4. Although not shownseparately in FIG. 18, in some embodiments, vehicle operation assistanceinformation management for autonomous vehicle control operation mayinclude maintaining, or managing, stored vehicle operation assistanceinformation. In some embodiments, identifying the vehicle operationassistance information at 18100 may include identifying a vehicleoperation assistance information item based on previously identifiedvehicle operation assistance information as indicated by the broken lineshown on the left of FIG. 18.

In some embodiments, identifying the second vehicle operation assistanceinformation item based on the first vehicle operation assistanceinformation item at 18100 may include copying the vehicle operationassistance information from the first vehicle operation assistanceinformation item to the second vehicle operation assistance information,or using the first vehicle operation assistance information item as thesecond vehicle operation assistance information item. In someembodiments, monitoring stored or currently presented vehicle operationassistance information may include periodically, or in response to anevent, such as traversing a defined geospatial distance in the vehicletransportation network at 18500, determining whether to identify avehicle operation assistance information item based on a previouslyidentified vehicle operation assistance information item at 18100.

In some embodiments, one or more elements of vehicle operationassistance information may be implemented in an external device. Forexample, identifying a vehicle operation assistance information item at18100, identifying an immanency for the vehicle operation assistanceinformation item at 18200, determining an urgency at 18300, storinginformation representing the vehicle operation assistance informationitem at 18600, or a combination thereof, may be implemented in anexternal device, the vehicle may communicate with the external devicevia a wireless electronic communication link, the vehicle may receiveprocessed, or partially processed, vehicle operation assistanceinformation from the external device, and the vehicle may utilize thevehicle operation assistance information item at 18400.

FIG. 19 is a diagram of determining an immanency for autonomous vehiclecontrol operation in accordance with this disclosure. In someembodiments, an immanency may indicate spatial or temporal distancebetween the vehicle and a geospatial location in the vehicletransportation network indicated by vehicle operation assistanceinformation, such as the vehicle operation assistance informationidentified as shown at 4100 in FIG. 4 or the vehicle operationassistance information identified as shown at 18100 in FIG. 18. In someembodiments, determining the immanency at 19000 may include identifyingcurrent operational parameters for the vehicle at 19100, identifying atarget location at 19200, identifying a cost at 19300, or a combinationthereof.

In some embodiments, the vehicle operation assistance information mayinclude an express or implied immanency and one or more elements ofdetermining an immanency, such as identifying a target location at19200, or identifying a cost at 19300, may be omitted. For example, thevehicle operation assistance information may indicate front collisioninformation. In some embodiments, the front collision information mayexpressly indicate an expected time to collision, such as three or fourseconds, which may be identified as the immanency. In some embodiments,the front collision information may omit an express immanency, and adefined front collision immanency, such as three or four seconds, may beidentified as the immanency.

In some embodiments, current operational parameters for the vehicle maybe identified at 19100. In some embodiments, identifying the currentoperational parameters at 19100 may include identifying a currentgeospatial location of the vehicle, a current vehicle operational statefor the vehicle, a current expected path for the vehicle, a currentroute for the vehicle, or a combination thereof. In some embodiments,the current geospatial location of the vehicle may be identifiedcontemporaneously with identifying the vehicle operation assistanceinformation. In some embodiments, identifying the current operationalparameters at 19100 may be similar to identifying current operationalparameters as shown at 5100 in FIG. 5, except as described herein.

In some embodiments, a target location may be identified at 19200. Insome embodiments, the vehicle operation assistance information mayindicate a geospatial location within the vehicle transportationnetwork, such as a geospatial point, which may be indicated by, forexample, GPS coordinates, a feature of the vehicle transportationnetwork, such as a lane or a road, or a portion thereof, which may beindicated by two or more geospatial locations, such as a firstgeospatial location along a the vehicle transportation network featurecorresponding to an edge of the portion of the vehicle transportationnetwork feature indicated by the vehicle operation assistanceinformation and a second geospatial location along the vehicletransportation network feature corresponding to an opposite edge of theportion of the vehicle transportation network feature indicated by thevehicle operation assistance information. In some embodiments,identifying the target location at 19200 may be similar to identifying atarget location as shown at 5200 in FIG. 5, except as described herein.

In some embodiments, the vehicle operation assistance information mayinclude information indicating a location of an expected vehicleoperation control transfer. For example, the vehicle operationassistance information may include a vehicle operation control transferrequest indicating a vehicle initiated transfer of control of thevehicle responsive to vehicle operation assistance informationindicating that a current route for the vehicle includes a drivercontrol portion, and identifying a target location at 19200 may includeidentifying a location in the vehicle transportation network of point ofconvergence between the route and the driver control portion of thevehicle transportation network relative to a current location of thevehicle in the route.

In another example, the vehicle operation assistance information mayinclude a vehicle operation control transfer request indicating avehicle initiated transfer of control of the vehicle, such as a vehicleinitiated transfer of control of the vehicle responsive to vehicleoperation assistance information received from an external device, suchas another vehicle, or generated based on sensor information from asensor of the vehicle, and identifying a target location at 19200 mayinclude identifying a location in the vehicle transportation networkindicated by, or based on, the received information.

In another example, the vehicle operation assistance information mayinclude a vehicle operation control transfer request indicating a driverinitiated transfer of control of the vehicle, and identifying a targetlocation at 19200 may include determining a temporal transfer period fortransferring vehicle control and identifying a location in the vehicletransportation network corresponding to an expected location of thevehicle in the vehicle transportation network at the end of the transferperiod based on current vehicle operational conditions.

In some embodiments, the vehicle operation assistance information mayinclude information indicating a location of a candidate vehicle controloperation. For example, the vehicle may traverse a portion of a vehicletransportation network in accordance with a defined route from an originto a destination; the route may include a turn from a road to anotherroad, and identifying a target location at 19200 may include identifyinga location of the turn in the vehicle transportation network.

In some embodiments, the vehicle operation assistance information mayinclude information indicating a location of a candidate vehicle controloperation relative to the vehicle. For example, the vehicle may traversea portion of a vehicle transportation network in a lane, vehicleoperation assistance information may be identified based on informationindicating that a cost for traversing the current portion of the vehicletransportation network via a current lane exceeds a cost for traversingthe current portion of the vehicle transportation network via anothercurrent lane, such as an adjacent lane, and identifying a targetlocation at 19200 may include identifying a location in the vehicletransportation network for changing lanes, which may be relative to acurrent location of the vehicle.

In some embodiments, a cost for the vehicle operation assistanceinformation may be identified at 19300. In some embodiments, a cost,such as a spatial or temporal cost, for the vehicle to traverse thevehicle transportation network from the current geospatial location ofthe vehicle identified at 19100 to the target geospatial locationidentified at 19200 based on the current operational parametersidentified at 19100 may be identified as the cost at 19300. For example,a geospatial distance in the vehicle transportation network between thecurrent geospatial location of the vehicle identified at 19100 and thetarget geospatial location identified at 19200 may be identified as aspatial cost, or a temporal distance, which may indicate an amount oftime, for the vehicle to traverse the vehicle transportation networkfrom the current geospatial location of the vehicle identified at 19100to the target geospatial location identified at 19200 based on thecurrent vehicle operating parameters, such as speed, identified at19100, may be identified as the cost. In some embodiments, identifyingthe cost at 19300 may be similar to identifying a cost as shown at 5400in FIG. 5, except as described herein.

In some embodiments, the target location may be identified at 19200based on the cost identified at 19300. For example, the vehicleoperation assistance information may include a vehicle operation controltransfer request indicating a driver initiated transfer of control ofthe vehicle a cost, such as a temporal period, for transferring vehiclecontrol may be identified at 19300, and identifying a target location at19200 may include determining an expected spatial location of thevehicle in the vehicle transportation network corresponding to the endof the temporal period for transferring vehicle control based on currentvehicle operating parameters as the target location.

In some embodiments, the cost may be identified at 19300 based onexpected right-of-way signal information for a traffic control device ofthe vehicle transportation network. For example, the vehicle operationassistance information may indicate an expected right-of-way signalstatus for a traffic control device, such as a current status, or astatus corresponding to an expected arrival of the vehicle at a locationin the vehicle transportation network corresponding to the trafficcontrol device based on current operating parameters for the vehicle. Insome embodiments, the cost may indicate an expected duration for thesignal, such as a period of time before a permitted right-of-way signaltransitions to a denied right-of-way signal, or a period of time beforea denied right-of-way signal transitions to a permitted right-of-waysignal.

FIG. 20 is a diagram of determining urgency for autonomous vehiclecontrol operation in accordance with this disclosure. In someembodiments, determining the urgency may include determining a temporalor spatial distance available for utilizing the vehicle operationassistance information and quantizing, or categorizing, the temporal orspatial distance into a defined set of urgency types, categories, orbands. In some embodiments, determining urgency at 20000 may be similarto the urgency determination shown at 4300 in FIG. 4, the urgencydetermination shown in FIG. 6, or the urgency determination shown at18300 in FIG. 18, except as described herein. In some embodiments,determining urgency at 20000 may include identifying a vehicle controlaction at 20100, determining an advisory action cost at 20200,evaluating an advisory cost at 20300, determining a warning action costat 20400, evaluating a warning cost at 20500, or a combination thereof.

In some embodiments, an available vehicle control action responsive tothe vehicle operation assistance information may be identified at 20100.A vehicle control action may indicate a vehicle control action,operation, or maneuver, such as accelerating, decelerating, turning, orstopping, that may be performed by the vehicle, such as in response todriver input or in response to Autonomous Vehicle control, to traverse aportion of the vehicle transportation network. In some embodiments,identifying an available vehicle control action at 20100 may be similarto the available vehicle control action identification shown at 6100 inFIG. 6, except as described herein.

In some embodiments, the available vehicle control action responsive tothe vehicle operation assistance information identified at 20100 mayinclude more than one vehicle control action, such as a primary vehiclecontrol action and a secondary vehicle control action. For example, thevehicle operation assistance information may include a vehicle operationcontrol transfer request, the primary vehicle control action may includea vehicle operation control transfer, and the secondary vehicle controlaction may include autonomously controlling the vehicle to traverse thevehicle transportation network in accordance with current operationalparameters, or to safely stop. In another example, the vehicle operationassistance information may include a candidate vehicle controloperation, such as a lane change, the primary vehicle control action mayinclude the lane change, and the secondary vehicle control action mayinclude autonomously controlling the vehicle to traverse the vehicletransportation network in accordance with current operationalparameters, such as by continuing to traverse the vehicle transportationnetwork via the current lane.

In some embodiments, a vehicle operation control transfer may be avehicle control action. For example, vehicle operation assistanceinformation, such as the vehicle operation assistance informationreceived as shown at 18100 in FIG. 18, may include a vehicle operationcontrol transfer request indicating a transfer of control of the vehiclefrom driver control to autonomous vehicle control or from autonomousvehicle control to driver control, and a transfer of vehicle control maybe identified as the available vehicle control action at 20100.

In some embodiments, an advisory action cost may be identified at 20200.In some embodiments, an action cost may indicate a cost, such as atemporal cost or a spatial cost, for the vehicle to traverse the vehicletransportation network in accordance with an identified vehicle controlaction, such as the vehicle control action identified at 20100, based onthe current vehicle operational conditions and, in some embodiments, oneor more acceptability metrics. In some embodiments, an advisory actioncost may be an action cost associated with one or more advisoryacceptability metrics, such as an advisory vehicle control transferperiod. In some embodiments, identifying an advisory action cost at20200 may be similar to the advisory action cost identification shown at6200 in FIG. 6, except as described herein.

In some embodiments, the vehicle operation assistance information mayinclude a vehicle operation control transfer request indicating a driverinitiated transfer of control of the vehicle and identifying theadvisory action cost at 20200 may include identifying an advisoryvehicle control transfer period, which may indicate a defined ordetermined temporal cost for transferring vehicle control, such as fiveseconds, and using the advisory vehicle control transfer period as theadvisory action cost.

In some embodiments, an advisory cost may be evaluated at 20300. In someembodiments, evaluating the advisory cost at 20300 may includeidentifying the advisory cost. In some embodiments, the advisory costmay be identified based on the advisory action cost identified at 20200and an advisory offset. For example, the advisory cost may be identifiedas a sum of the advisory action cost identified at 20200 and theadvisory offset. In some embodiments, evaluating the advisory cost at20300 may be similar to the advisory cost evaluation shown at 6300 inFIG. 6, except as described herein.

In some embodiments, determining the advisory cost at 20300 may includeidentifying the advisory offset. In some embodiments, an advisory offsetmay be identified based on vehicle operation assistance information,such as the vehicle operation assistance information received as shownat 18100 in FIG. 18. For example, an advisory offset, such astwenty-five seconds, may be associated with vehicle operation assistanceinformation indicating that a current route for the vehicle includes adriver control portion.

In some embodiments, the advisory offset may be zero or may be omitted,and the advisory cost may be based on the advisory action costidentified at 20200. For example, an advisory offset associated withvehicle operation assistance information indicating a driver initiatedvehicle operation control transfer may be associated with an advisoryoffset of zero, or an advisory offset for vehicle operation assistanceinformation indicating a driver initiated vehicle operation controltransfer may be omitted.

In some embodiments, evaluating the advisory cost at 20300 may includedetermining whether an immanency, such as the immanency identified asshown at 18200 in FIG. 18 or as shown in FIG. 19, exceeds the advisorycost. In some embodiments, the immanency may exceed the advisory costand the current urgency may be identified as the advance urgency at20310.

In some embodiments, the immanency may be within the advisory cost and awarning action cost may be determined at 20400. In some embodiments, thewarning action cost identified at 20400 may indicate temporal cost forthe vehicle to traverse the vehicle transportation network in accordancewith the vehicle control action identified at 20100 and a correspondingwarning acceptability metric. For example, the warning acceptabilitymetric may be a warning vehicle control transfer period, such as twoseconds.

In some embodiments, a warning cost may be evaluated at 20500. In someembodiments, evaluating the warning cost at 20500 may includeidentifying the warning cost. In some embodiments, the warning cost maybe based on the warning action cost identified at 20400 and a warningoffset, such as one second. In some embodiments, warning offset may beomitted, and the warning cost may be based on the warning action costidentified at 20400.

In some embodiments, evaluating the warning cost at 20500 may includedetermining whether an immanency, such as the immanency identified asshown at 18200 in FIG. 18 or as shown in FIG. 19, exceeds the warningcost. In some embodiments, the immanency may exceed the warning cost andthe current urgency may be identified as the advisory urgency at 20510.In some embodiments, the immanency may be within the warning cost andthe current urgency may be identified as the warning urgency at 20520.

FIG. 21 is a diagram of utilizing vehicle operation assistanceinformation in accordance with this disclosure. In some embodiments,utilizing vehicle operation assistance information, such as the vehicleoperation assistance information identified as shown at 18100 in FIG.18, may include presenting a representation of the vehicle operationassistance information, controlling the vehicle to traverse a portion ofthe vehicle transportation network in accordance with an identifiedvehicle control action, such as the vehicle control action at 20100 inFIG. 21, or a combination thereof.

In some embodiments, utilizing vehicle operation assistance informationat 21000 may include evaluating an urgency for the vehicle operationassistance information at 21100, evaluating an immanency for the vehicleoperation assistance information at 21200, operating the vehicle inaccordance with an identified vehicle control action at 21300,generating a representation of the vehicle operation assistanceinformation at 21400, presenting a primary portion of the graphicalpresentation at 21500, delaying at 51600, clearing the primary portionat 21610, presenting a secondary portion of the graphical presentationat 21700, delaying at 21800, clearing the secondary portion at 21810, ora combination thereof.

Although not shown separately in FIG. 21, in some embodiments, utilizingvehicle operation assistance information at 21000 may includedetermining whether a candidate vehicle control operation is an approvedvehicle control operation. In some embodiments, a candidate vehiclecontrol operation not otherwise identified as an approved vehiclecontrol operation may be identified as an unapproved vehicle controloperation. In some embodiments, a candidate vehicle control operationmay be identified as an approved vehicle control operation in responseto driver input, such as driver input indicating that the candidatevehicle control operation is an approved vehicle control operation.

For example, the candidate vehicle control operation may be a lanechange vehicle control operation identified based on current vehicleoperating environment information, the candidate vehicle controloperation may be identified as an unapproved vehicle control operationin response to identifying the candidate vehicle control operation, andthe candidate vehicle control operation may be identified as an approvedvehicle control operation in response to driver input indicating thatthe candidate vehicle control operation is an approved vehicle controloperation.

In another example, the vehicle may traverse a portion of the vehicletransportation network in accordance with a defined route from an originto a destination, which may be a route identified in response to driverinput, the candidate vehicle control operation may be identified as anexpected vehicle control operation based on the route, and the candidatevehicle control operation may be identified as an approved vehiclecontrol operation in response to identifying the route.

In another example, the candidate vehicle control operation may beidentified as an approved vehicle control operation in response todriver input, such as driver input requesting the candidate vehiclecontrol operation. For example, the candidate vehicle control operationmay be identified as an approved vehicle control operation in responseto a driver initiated vehicle operation parking assistance request.

In some embodiments, a candidate vehicle control operation identified asan approved vehicle control operation may be identified as an unapprovedvehicle control operation. For example, the vehicle may traverse aportion of the vehicle transportation network in accordance with adefined route from an origin to a destination, the candidate vehiclecontrol operation may be identified as an expected vehicle controloperation based on the route, such as a turn from a road to anotherroad, the candidate vehicle control operation may be identified as anapproved vehicle control operation in response to identifying the route,and the candidate vehicle control operation may be identified as anunapproved vehicle control operation in response to driver inputindicating that the candidate vehicle control operation is an unapprovedvehicle control operation, canceling the route, or changing the routesuch that the candidate vehicle control operation is no longer includedin the route.

In some embodiments, utilizing the vehicle operation assistanceinformation at 21000 may include evaluating an urgency, such as thecurrent urgency identified as shown at 18300 in FIG. 18 or as shown inFIG. 20. Although not shown separately in FIG. 21, in some embodiments,evaluating the urgency at 21100 may include identifying and evaluatingvehicle operation control metrics for the vehicle operation assistanceinformation at 21100. For example, the vehicle operation assistanceinformation may indicate a request for vehicle operation controltransfer, and utilizing the vehicle operation assistance information at21000 may include evaluating vehicle operation control metrics for thevehicle operation assistance information at 21100. In some embodiments,evaluating the vehicle operation control metrics for the vehicleoperation assistance information at 21100 may be omitted. For example,the urgency may be the advance urgency, the vehicle operation controlmetrics for the vehicle operation assistance information may beidentified at 21100, and evaluating the vehicle operation controlmetrics may be omitted.

The vehicle operation control metrics may include one or more aspects ofvehicle operation control that may be evaluated for vehicle operationcontrol transfer. For example, the vehicle operation control metrics mayinclude a steering control metric, an acceleration control metric, asituational awareness control metric, or a combination thereof.

In some embodiments, evaluating the vehicle operation control metrics at21100 may include determining a vehicle status, a driver status, or acombination of vehicle status and driver status corresponding torespective vehicle operation control metrics. A driver statuscorresponding to a vehicle operation control metric may indicate astatus or condition of the driver with respect to an aspects of vehicleoperation control corresponding the vehicle operation control metric.

In some embodiments, evaluating a steering control metric may includedetermining whether the driver of the vehicle is actively engaged with asteering control unit of the vehicle, such as a steering wheel. Forexample, the steering wheel may include one or more sensors configuredto sense driver engagement, such as contact or pressure, with thesteering wheel, and the steering control metric may be determined basedon data or signals from the steering wheel sensors. For example, thesteering wheel sensor data may indicate that the driver is gripping thesteering wheel and the steering control metric may evaluate to apositive value or true, indicating that the driver status for thesteering control metric is engaged. In another example, the steeringwheel sensor data may indicate that the driver is not gripping thesteering wheel, or is not sufficiently gripping the steering wheel, andthe steering control metric may evaluate to a negative value or false,indicating that the driver status for the steering control metric isdisengaged.

In some embodiments, evaluating an acceleration control metric mayinclude determining whether the driver of the vehicle is activelyengaged with one or more acceleration control units of the vehicle, suchas a gas pedal or a brake pedal. For example, a gas pedal, a brakepedal, or both, respectively, may include one or more sensors, such aspressure sensors, configured to sense driver engagement, such as contactor pressure, with the respective pedal, and the acceleration controlmetric may be determined based on data or signals from the respectivepedal sensors. For example, the pedal sensor data may indicate that thedriver is pressing the acceleration pedal and the acceleration controlmetric may evaluate to a positive value or true, indicating that thedriver status for the acceleration control metric is engaged. In anotherexample, the pedal sensor data may indicate that the driver is not incontact with either pedal, or is not sufficiently actuating eitherpedal, and the acceleration control metric may evaluate to a negativevalue or false, indicating that the driver status for the accelerationcontrol metric is disengaged.

In some embodiments, evaluating a situational awareness control metricmay include determining whether the driver of the vehicle is activelyengaged with, or aware of, the operational state of the vehicle. Forexample, the vehicle may include one or more situational awarenesssensors configured to identify information indicative of driverattention or engagement with vehicle operations. In some embodiments, avehicle may include one or more sensors, such as cameras, configured tocapture images of the driver, and a unit of the vehicle, may beconfigured to identify a field of view or focal point for the driverbased on the driver image data. For example, the situational awarenesssensor data may indicate that a focal point for the driver is directedin accordance with the expected path for the vehicle, and thesituational awareness control metric may evaluate to a positive value ortrue, indicating that the driver status for the situational awarenesscontrol metric is engaged. In another example, the situational awarenesssensor data may indicate that the field of view of the driver is notdirected in accordance with the expected path for the vehicle, and thesituational awareness control metric may evaluate to a negative value orfalse, indicating that the driver status for the situational awarenesscontrol metric is disengaged.

In some embodiments, an immanency, such as the immanency identified asshown at 18200 in FIG. 18 or as shown in FIG. 19, may be evaluated at21200. For example, the urgency evaluated at 21100 may be the warningurgency, and the immanency may be evaluated at 21200. In anotherexample, the urgency evaluated at 21100 may be the advisory urgency, andevaluating the immanency at 21200 may be omitted. In some embodiments,evaluating the immanency at 21200 may include determining whether theimmanency exceeds a minimum relevant immanence, which may indicate adefined value, such as zero seconds or one second.

In some embodiments, utilizing the vehicle operation assistanceinformation may include operating the vehicle in accordance with anidentified vehicle control action at 21300. For example, the immanencyevaluated at 21200 may be within the minimum relevant immanence andutilizing the vehicle operation assistance information may includeoperating the vehicle in accordance with an identified vehicle controlaction, such as the vehicle control action identified as shown at 20100in FIG. 20. In another example, the immanency evaluated at 21200 mayexceed the minimum relevant immanence and operating the vehicle inaccordance with an identified vehicle control action may be omitted.

In an example, vehicle operation assistance information, such as thevehicle operation assistance information identified as shown at 18100 inFIG. 18, may include a vehicle operation control transfer request,vehicle control transfer may be identified as a vehicle control action,the immanency evaluated at 21200 may be within the minimum relevantimmanence, the driver status for each of the vehicle operation controlmetrics identified at 21100 may indicate that the driver is engaged,operating the vehicle in accordance with an identified vehicle controlaction at 21300 may include transferring vehicle control, and arepresentation of the vehicle operation assistance informationindicating the transfer of control may be generated at 21500.

In another example, vehicle operation assistance information, such asthe vehicle operation assistance information identified as shown at18100 in FIG. 18, may include a vehicle operation control transferrequest, vehicle control transfer may be identified as a primary vehiclecontrol action, a secondary vehicle control action, such as thesecondary vehicle control action identified as shown at 20100 in FIG.20, may be identified, the immanency evaluated at 21200 may be withinthe minimum relevant immanence, the driver status for a vehicleoperation control metric identified at 21100 may indicate that thedriver is disengaged, utilizing the vehicle operation assistanceinformation at 21300 may include controlling the vehicle in accordancewith the secondary vehicle control action, and a representation of thevehicle operation assistance information indicating the secondaryvehicle control action may be generated at 21400. In some embodiments,presenting a representation of the vehicle operation assistanceinformation indicating the secondary vehicle control action may includepresenting a representation of the vehicle operation assistanceinformation indicating that the vehicle control transfer was omitted,which may include presenting a representation of one or more disengagedvehicle operation control metrics.

In some embodiments, operating the vehicle in accordance with anidentified vehicle control action at 21300 may include omitting avehicle control action, or a primary vehicle control action, in responseto determining that a candidate vehicle control operation is anunapproved vehicle control operation, and operating the vehicle inaccordance with current operating parameters or a secondary vehiclecontrol action.

For example, the candidate vehicle control operation may be a lanechange vehicle control operation identified based on current vehicleoperating environment information, the candidate vehicle controloperation may be identified as an unapproved vehicle control operationin response to identifying the candidate vehicle control operation, thelane change vehicle control operation may be identified as a primaryvehicle control action, maintaining current operating parameters may beidentified as a secondary vehicle control action, and operating thevehicle in accordance with an identified vehicle control action at 21300may include omitting the lane change vehicle control operation inresponse to determining that a candidate vehicle control operation is anunapproved vehicle control operation, and operating the vehicle inaccordance with the secondary vehicle control action. In anotherexample, the lane change vehicle control operation may be identified asan approved vehicle control operation in response to driver inputindicating that the candidate vehicle control operation is an approvedvehicle control operation, and operating the vehicle in accordance withan identified vehicle control action at 21300 may include autonomouslyoperating the vehicle to change lanes in accordance with the candidatevehicle control operation.

In another example, the vehicle may traverse a portion of the vehicletransportation network in accordance with a defined route from an originto a destination, which may be a route identified in response to driverinput, the candidate vehicle control operation may be identified as anexpected vehicle control operation, such as a turn from a road toanother road, based on the route, the candidate vehicle controloperation may be identified as an approved vehicle control operation inresponse to identifying the route, the turn vehicle control operationmay be identified as a primary vehicle control action, maintainingcurrent operating parameters may be identified as a secondary vehiclecontrol action, and operating the vehicle in accordance with anidentified vehicle control action at 21300 may include autonomouslyoperating the vehicle to turn in accordance with the candidate vehiclecontrol operation. In another example, the turn vehicle controloperation may be identified as an unapproved vehicle control operationin response to driver input indicating that the candidate vehiclecontrol operation is an unapproved vehicle control operation, andoperating the vehicle in accordance with an identified vehicle controlaction at 21300 may include omitting the turn vehicle control operationin response to determining that the candidate vehicle control operationis an unapproved vehicle control operation, and operating the vehicle inaccordance with the secondary vehicle control action.

In some embodiments, a representation of the vehicle operationassistance information may be identified, or generated, at 21400.Generating, or identifying, the representation of the vehicle operationassistance information may include generating, or identifying, agraphical representation of the vehicle operation assistanceinformation, an audible representation of the vehicle operationassistance information, or both.

In some embodiments, the representation of the vehicle operationassistance information generated at 21400 may depend on the urgencyevaluated at 21100. For example, the urgency may be an advance urgencyand an advance representation of the vehicle operation assistanceinformation may be generated. In another example, the urgency may be anadvisory urgency and an advisory representation of the vehicle operationassistance information may be generated. In another example, the urgencymay be a warning urgency and a warning representation of the vehicleoperation assistance information may be generated.

In some embodiments, the representation of the vehicle operationassistance information generated at 21400 may depend on whether acandidate vehicle control operation is an approved vehicle controloperation or an unapproved vehicle control operation.

For example, the vehicle operation assistance information may indicate acandidate vehicle control operation identified based on a defined route,the urgency may be an advisory urgency, or the urgency may be a warningurgency and the immanency may exceed the minimum relevant immanence, thecandidate vehicle control operation may be an approved vehicle controloperation, and generating the representation of the vehicle operationassistance information at 21400 may include generating a representationof an offer to cancel of the vehicle control operation.

In another example, the vehicle operation assistance information mayindicate a candidate vehicle control operation identified based oncurrent vehicle operating environment information, the urgency may be anadvisory urgency, or the urgency may be a warning urgency and theimmanency may exceed the minimum relevant immanence, the candidatevehicle control operation may be an unapproved vehicle controloperation, and generating the representation of the vehicle operationassistance information at 21400 may include generating a representationof a request for approval of the vehicle control operation.

In another example, the vehicle operation assistance information mayindicate a candidate vehicle control operation identified based oncurrent vehicle operating environment information, the urgency may be awarning urgency and the immanency may be within the minimum relevantimmanence, the candidate vehicle control operation may be an unapprovedvehicle control operation, and generating the representation of thevehicle operation assistance information at 21400 may include generatinga graphical representation of an aborted vehicle control operation.

In some embodiments, generating or identifying the representation of thevehicle operation assistance information at 21400 may include generatingor identifying a graphical, or visual, representation of the vehicleoperation assistance information. Generating, or identifying, thegraphical representation of the vehicle operation assistance informationmay include identifying, or generating, one or more pictographicrepresentations of the vehicle operation assistance information,identifying one or more text representations of the vehicle operationassistance information, identifying one or more verbal descriptions ofthe vehicle operation assistance information, or a combination thereof.Examples of pictographic representation, text representations, andverbal descriptions, of the vehicle operation assistance information areshown in FIGS. 22-26.

In some embodiments, the graphical representation of the vehicleoperation assistance information may be presented via the primarygraphical display portion at 21500. For example, the urgency may be anadvisory urgency, a graphical representation of the vehicle operationassistance information may be generated at 21400, and the graphicalrepresentation of the vehicle operation assistance information generatedat 21400 may be presented via the primary graphical display portion at21500. In another example, the urgency may be a warning urgency, theimmanency evaluated at 21200 may exceed the minimum relevant immanence,a graphical representation of the vehicle operation assistanceinformation may be generated at 21400, a graphical representation of thevehicle operation assistance information may be generated at 21400, andthe graphical representation of the vehicle operation assistanceinformation generated at 21400 may be presented via the primarygraphical display portion at 21500. In another example, the urgency maybe a warning urgency, the immanency evaluated at 21200 may be within theminimum relevant immanence, the vehicle may be operated in accordancewith an identified vehicle control action at 21300, a graphicalrepresentation of the vehicle operation assistance information may begenerated at 21400, and the graphical representation of the vehicleoperation assistance information generated at 21400 may be presented viathe primary graphical display portion at 21500. In some embodiments,presenting the graphical representation of the vehicle operationassistance information via the primary graphical display portion at21500 may be similar the primary presentation shown in FIG. 11, exceptas described herein.

In some embodiments, a primary delay timer, or other temporal delay, maybe initiated at 21600 in response to, or in conjunction with, presentingthe graphical representation of the vehicle operation assistanceinformation via the primary graphical display portion at 21500.

In some embodiments, the primary graphical display portion may becleared at 21610. In some embodiments, the graphical representation ofthe vehicle operation assistance information presented via the primarygraphical display portion at 21500 may be cleared, or omitted from theprimary graphical display portion, in response to an event, such asdetecting the primary delay timer initiated at 21600 exceeding a definedprimary display duration, such as three seconds, detecting that thevehicle traversed the vehicle transportation network in accordance withthe vehicle control action, or otherwise determining that the vehicleoperation assistance information is no longer relevant.

In some embodiments, the graphical representation of the vehicleoperation assistance information may be presented via the secondarygraphical display portion at 21700. In some embodiments, presenting thesecondary portion at 21700 may be similar the secondary presentationshown in FIG. 12, except as described herein. In some embodiments, thegraphical representation of the vehicle operation assistance informationmay be presented via the secondary graphical display portion at 21700 inresponse to detecting the primary delay timer initiated at 21600exceeding a defined secondary display delay, such as one second. In someembodiments, the graphical representation of the vehicle operationassistance information may be presented via the secondary graphicaldisplay portion at 21700 in conjunction with initiating the primarydelay timer at 21600.

In some embodiments, evaluating the immanency at 21200, operating thevehicle in accordance with the identified vehicle control action at21300, and presenting the graphical representation of the vehicleoperation assistance information via the primary graphical displayportion at 21500, may be omitted and the graphical representation of thevehicle operation assistance information may be presented via thesecondary graphical display portion at 21700 in response to generatingthe representation at 21400. For example, the urgency may be identifiedas the advance urgency, evaluating the immanency at 21200, operating thevehicle in accordance with the identified vehicle control action at21300, and presenting the graphical representation of the vehicleoperation assistance information via the primary graphical displayportion at 21500, may be omitted, and the graphical representation ofthe vehicle operation assistance information may be presented via thesecondary graphical display portion at 21700 in response to generatingthe representation at 21400.

In some embodiments, a secondary delay timer, or other temporal delay,may be initiated at 21800. For example, a secondary delay timer may beinitiated at 21800 in response to, or in conjunction with, presentingthe graphical representation of the vehicle operation assistanceinformation via the secondary graphical display portion at 21700.

In some embodiments, the secondary portion may be cleared at 21810. Insome embodiments, the graphical representation of the vehicle operationassistance information presented via the secondary graphical displayportion at 21700 may be cleared, or omitted from the secondary graphicaldisplay portion, in response to an event, such as detecting thesecondary delay timer initiated at 21800 exceeding a defined secondarydisplay duration, such as five seconds, detecting that the vehicletraversed the vehicle transportation network in accordance with thevehicle control action, or otherwise determining that the vehicleoperation assistance information is no longer relevant.

Although not shown separately in FIG. 21, in some embodiments,generating the representation at 21400 may include generating oridentifying an auditory representation of the vehicle operationassistance information item and controlling the auditory presentationdevice to present the auditory representation of the vehicle operationassistance information item.

For example, the vehicle operation assistance information may indicate avehicle initiated request for vehicle operation control transferresponsive to identifying a driver control portion of the vehicletransportation network in a current route for the vehicle, the urgencymay be identified as the advanced urgency, and utilizing the vehicleoperation assistance information at 21000 may include generating oridentifying an auditory representation of the vehicle operationassistance information item at 21400 and controlling the auditorypresentation device to present the auditory representation of thevehicle operation assistance information item in conjunction withpresenting the secondary portion at 21700.

In another example, the vehicle operation assistance information mayindicate a vehicle initiated request for vehicle operation controltransfer from autonomous vehicle control to driver control, the urgencymay be identified as the warning urgency, the immanency evaluated at21200 may be exceed the minimum relevant immanence, a disengaged driverstatus may be identified for one or more vehicle operational controlmetrics at 21100, and utilizing the vehicle operation assistanceinformation at 21000 may include generating or identifying an auditoryrepresentation of the vehicle operation assistance information item at21400 and controlling the auditory presentation device to present theauditory representation of the vehicle operation assistance informationitem in conjunction with presenting the primary portion at 21500.

In some embodiments, vehicle operation assistance information may begenerated in response to information indicating a vehicle operationcontrol transfer, such as a transfer from autonomous vehicle control todriver control, or from driver control to autonomous vehicle control, orin response to information indicating an autonomous vehicle operation ormaneuver, such as a lane change, a speed change, a turn, or parking. Insome embodiments, vehicle operation assistance information forautonomous vehicle control operation may include presenting arepresentation of the vehicle operation assistance information. Examplesof presenting vehicle operation assistance information for vehicleoperation control transfer are shown in FIG. 22, examples of presentingvehicle operation assistance information for an autonomous vehicle lanechange operation are shown in FIGS. 23-24, an example of presentingvehicle operation assistance information for an autonomous vehicle turnoperation is shown in FIG. 25, and an example of presenting vehicleoperation assistance information for an autonomous vehicle speed changeoperation is shown in FIG. 26.

FIG. 22 shows examples of graphical representations of vehicle operationassistance information for autonomous vehicle control transfer inaccordance with this disclosure. In some embodiments, generating arepresentation 22100/22200/22300 of the vehicle operation assistanceinformation, such as the generating shown at 21400 in FIG. 21, mayinclude identifying, or generating, one or more text representations22218/22218 of the vehicle operation assistance information, generatingor identifying one or more pictographic representations22112-22116/22212-22216/22312-22316 of the vehicle operation assistanceinformation, generating or identifying one or more verbal descriptions22122/22222/22322 of the vehicle operation assistance information, or acombination thereof. In some embodiments, the graphical representationsof vehicle operation assistance information for autonomous vehiclecontrol transfer may be similar to the graphical representation shown inFIG. 17, except as described herein.

In some embodiments, a pictographic representation22112-22116/22212-22216/22312-22316 of vehicle operation assistanceinformation may be similar to an icon, and may include a simple, easilyrecognizable, representation of the vehicle operation assistanceinformation.

In some embodiments, a pictographic representation22212-22216/22212-22216/22312-22316 of vehicle operation assistanceinformation may be identified, or generated, based on the vehicleoperation assistance information, the immanency, the urgency, vehicleoperation control metrics, driver status information for the vehicleoperation control metrics, vehicle operation control status informationfor the vehicle operation control metrics, or a combination thereof. Insome embodiments, the vehicle operation control status information mayindicate whether the corresponding vehicle operation control is drivercontrolled or autonomous vehicle controlled. In some embodiments, one ormore pictographic representation 22212-22216/22212-22216/22312-22316 mayoscillate, such as in size, color, or brightness.

For example, the vehicle operation assistance information may indicate arequest for vehicle operation control transfer, one or more vehicleoperation control metrics corresponding to the request, such as asteering control metric, an acceleration control metric, and asituational awareness control metric, may be identified, driver statusinformation corresponding to the vehicle operation control metrics maybe identified, vehicle operation control status informationcorresponding to the vehicle operation control metrics may beidentified, an immanency may be identified, an urgency may beidentified, and presenting a representation 22200/22200/22300 of thevehicle operation assistance information may include identifying, orgenerating, pictographic representations22212-22216/22212-22216/22312-22316 of one or more of the vehicleoperation control metrics, such as a pictographic representation of anacceleration vehicle operation control metric 22212/22212/22312, apictographic representation of a steering vehicle operation controlmetric 22214/22214/22314, or a pictographic representation of asituational awareness vehicle operation control metric22216/22216/22316, as shown, based on the vehicle operation controlmetrics, the driver status information, the vehicle operation controlstatus information, the immanency, the urgency, or a combinationthereof. In some embodiments, a pictographic representation22212-22216/22212-22216/22312-22316 may include a visual indication ofthe corresponding driver control status, the corresponding vehicleoperation control status, the immanency, the urgency, or a combinationthereof.

In some embodiments, a text representation 22218/22218 of the vehicleoperation assistance information may include a representation of theimmanence. For example, the vehicle operation assistance information mayindicate a request for vehicle operation control transfer, and the textrepresentation 22218/22218 of the vehicle operation assistanceinformation may indicate a temporal distance, or amount of time, to thevehicle operation control transfer, such as “30 seconds”.

In some embodiments, a verbal description 22222/22222/22322 of thevehicle operation assistance information may explain or confirm themeaning of the pictographic representation22212-22216/22222-22216/22312-22316, which may include an explanation ofthe vehicle operation assistance information, an explanation of one ormore of the vehicle operation control metrics, a representation of theimmanence, an explanation of a vehicle operation control status, or acombination thereof. In some embodiments, a verbal descriptionexplaining one or more of the identified vehicle operation controlmetrics may be omitted.

In an example, as shown in the representation at the top 22100 of FIG.22, the vehicle operation assistance information may indicate a driverinitiated request for vehicle operation control transfer, the immanencymay be identified as five (5) seconds, the urgency may be identified asthe advisory urgency, a steering control metric, an acceleration controlmetric, and a situational awareness control metric, may be identified, adisengaged driver status may be identified for each of the steeringcontrol metric, the acceleration control metric, and the situationalawareness control metric, the text representation 22118 may include “5seconds”, and a first portion 22110 of the graphical representation mayinclude a pictographic representation of the acceleration control metric22112, which may visually indicate the corresponding disengaged driverstatus using, for example, a defined color, such as yellow, as indicatedby the stippling at 22112, a pictographic representation of the steeringcontrol metric, which may visually indicate the corresponding disengageddriver status, as indicated by the stippling at 22114, and apictographic representation of the situational awareness control metric,which may visually indicate the corresponding disengaged driver status,as indicated by the stippling at 22116, which may be presented via theprimary graphical display portion. A second portion 22120 of therepresentation at the top 22100 of FIG. 22 may include a verbaldescription 22122 explaining the request for vehicle operation controltransfer, the steering control metric, the acceleration control metric,and the immanency, which may be presented via the secondary graphicaldisplay portion. In the in the representation shown at the top 22100 ofFIG. 22, a verbal description explaining the situational awarenessvehicle operation control metric is omitted.

In another example, as shown in the representation at the middle 22200of FIG. 22, the vehicle operation assistance information may indicate adriver initiated request for vehicle operation control transfer, theimmanency may be identified as three (3) seconds, the urgency may beidentified as the warning urgency, a steering control metric, anacceleration control metric, and a situational awareness control metric,may be identified, an engaged driver status may be identified for thesteering control metric, a disengaged driver status may be identifiedfor the acceleration control metric, and an engaged driver status may beidentified for the situational awareness control metric, the textrepresentation 22218 may include “3 seconds”, and a first portion 22210of the graphical representation may include a pictographicrepresentation of the acceleration control metric 22212, which mayvisually indicate the corresponding disengaged driver status using, forexample, a defined color, such as red, as indicated by the whitecoloring at 22212, and which may include oscillation, a pictographicrepresentation of the steering control metric, which may visuallyindicate the corresponding engaged driver status using, for example, adefined color, such as green, as indicated by the black coloring at22214, and a pictographic representation of the situational awarenesscontrol metric, which may visually indicate the corresponding engageddriver status, as indicated by the black coloring at 22216, which may bepresented via the primary graphical display portion. A second portion22220 of the representation at the middle 22200 of FIG. 22 may include averbal description 22222 explaining the request for vehicle operationcontrol transfer, the disengaged steering control metric, and theimmanency, which may be presented via the secondary graphical displayportion. In the in the representation shown at the middle 22200 of FIG.22, a verbal description explaining the situational awareness vehicleoperation control metric is omitted.

In another example, as shown in the representation at the bottom 22300of FIG. 22, the vehicle operation assistance information may indicate adriver initiated request for vehicle operation control transfer, thevehicle operation control transfer may be performed, such as in responseto determining an engaged driver status for the identified vehicleoperation control metrics, and a first portion 22310 of the graphicalrepresentation may include a pictographic representation of theacceleration control metric 22312, which may visually indicate atransferred operational control status for each of the identifiedvehicle operation control metrics using, for example, a defined color,such as green, as indicated by the black coloring at 22312/22314/22316,which may be presented via the primary graphical display portion. Asecond portion 22320 of the representation at the bottom 22300 of FIG.22 may include a verbal description 22322 explaining that the vehicleoperation control transfer is complete, which may be presented via thesecondary graphical display portion.

FIGS. 23-24 show examples of graphical representations of vehicleoperation assistance information for autonomous vehicle control lanechange in accordance with this disclosure. In some embodiments, theurgency of vehicle operation assistance information for autonomousvehicle control lane change may be the advance urgency, and presentingthe vehicle operation assistance information may be omitted. In someembodiments, the urgency of vehicle operation assistance information forautonomous vehicle control lane change may be the advisory or thewarning urgency, and the vehicle operation assistance information may bepresented in response to identifying the vehicle operation assistanceinformation, as shown in FIG. 23, the vehicle operation assistanceinformation may be presented in response to receiving informationapproving the autonomous vehicle control lane change, as shown in FIG.24, or the vehicle operation assistance information may be presented inresponse to determining that the immanency of vehicle operationassistance information for autonomous vehicle control lane change iswithin the minimum relevant immanence, as also shown in FIG. 24.

FIG. 23 shows an example of a graphical representations of vehicleoperation assistance information for autonomous vehicle control lanechange in accordance with this disclosure. In some embodiments, arepresentation 23000 of the vehicle operation assistance information maybe generated, such as the generating shown at 21400 in FIG. 21. In someembodiments, the representation 23000 may include a first portion 23100,a second portion 23200, or both. In some embodiments, generating therepresentation 23000 may include generating, or identifying, one or morepictographic representations 23110-23120/23210-23260 of the vehicleoperation assistance information, generating or identifying one or moreverbal descriptions 23130 of the vehicle operation assistanceinformation, or a combination thereof. In some embodiments, thegraphical representations of vehicle operation assistance informationfor autonomous vehicle control operation may be similar to the graphicalrepresentation shown in FIG. 17, except as described herein.

In some embodiments, a pictographic representation23110-23120/23210-23260 of vehicle operation assistance information maybe identified, or generated, based on the vehicle operation assistanceinformation, the immanency, the urgency, whether a candidate vehiclecontrol operation is an approved vehicle control operation, or acombination thereof.

For example, the vehicle operation assistance information may indicate alane change vehicle control operation identified based on currentvehicle operating environment information, an immanency may beidentified, an urgency may be identified, whether the candidate vehiclecontrol operation is an approved vehicle control operation may beidentified, and generating a representation 23000 of the vehicleoperation assistance information may include identifying, or generating,pictographic representations 23110-23120/23210-23260, which may includeone or more pictographic representations of a current vehicleoperational environment 23110/23120, a pictographic representation ofthe candidate vehicle control operation 23120, a pictographicrepresentation of the vehicle 23220, or a combination thereof.

In some embodiments, a pictographic representations of a current vehicleoperational environment, such as a graphical representation of a portionof the vehicle transportation network spatially proximate to thevehicle, may be a perspective representation, as shown at 23110. In someembodiments, a pictographic representation of a current vehicleoperational environment may be a top-down, or bird's eye,representation, as shown at 23210.

In some embodiments, a pictographic representation of a current vehicleoperational environment 23210 may include a pictographic representationof a current portion of the vehicle transportation network 23210, apictographic representation of one or more other vehicles 23212proximate to the vehicle, a graphical representation of expected spatialavailability proximate to the vehicle 23214/23216/23218. In someembodiments, the graphical representation of expected spatialavailability proximate to the vehicle 23214/23216/23218, may be aheat-map or color-map representation of probabilities that areasproximate to the vehicle in the vehicle transportation network areavailable for traversal by the vehicle. Although not shown expressly inFIG. 23, in some embodiments, a pictographic representation of a currentvehicle operational environment 23210 may be generated based on sensordata, such as data generated by a sensor of the vehicle, such as thesensors 1360 shown in FIG. 1. For example, one or more sensors maydetect road geometry and obstacles, such as fixed obstacles, vehicles,pedestrians, or the like, and the graphical representation of expectedspatial availability proximate to the vehicle may be based on the senseddata.

In some embodiments, the graphical representation of expected spatialavailability proximate to the vehicle may include a first portion 23214indicating that an expected spatial availability for the portion of thevehicle transportation network represented thereby is high, as indicatedby the stippling shown at 23214 in FIG. 23, which may indicate adetermination of a high probability, such as a probability greater thana defined available threshold, such as 95%, that the correspondingportion of the vehicle transportation network is available for traversalby the vehicle. Although the high availability areas are shown withstippling in FIG. 23, the high probability areas 23214 may berepresented by any visual representation capable of indicating probableavailability, such as the color green.

In some embodiments, the graphical representation of expected spatialavailability proximate to the vehicle may include a second portion 23216indicating that an expected spatial availability for the portion of thevehicle transportation network represented thereby is low, as indicatedby the cross-hatching shown at 23216 in FIG. 23, which may indicate adetermination of a low probability, such as a probability within adefined unavailable threshold, such as 25%, that the correspondingportion of the vehicle transportation network is unavailable fortraversal by the vehicle. Although the low availability areas 23216 areshown with cross-hatching in FIG. 23, the low probability areas may berepresented by any visual representation capable of indicating probableunavailability, such as the color red.

In some embodiments, the graphical representation of expected spatialavailability proximate to the vehicle may include a third portion 23218indicating that an expected spatial availability for the portion of thevehicle transportation network represented thereby is higher than thelow probability and lower than the high probability, such as in therange 26-94%, as indicated by the diagonal lines shown at 23218 in FIG.23, which may indicate a determination of a probability, such as aprobability greater than the defined unavailable threshold and withinthe defined available threshold, that the corresponding portion of thevehicle transportation network is available-with-caution for traversalby the vehicle. Although the available-with-caution areas 23218 areshown with diagonal lines in FIG. 23, the available-with-caution areasmay be represented by any visual representation capable of indicatingconditional availability, such as the color yellow.

In some embodiments, a verbal description 23130 of the vehicle operationassistance information may explain or confirm the meaning of thepictographic representation 23110-23120/23210-23260, which may includean explanation of the vehicle operation assistance information, arequest for approval of a vehicle operation, a representation of theimmanence, or a combination thereof. Although shown below some of thepictographic representations of the current vehicle operationalenvironment 23110/23120, the verbal description 23130 of the vehicleoperation assistance information may be presented above, to the side, orsuperimposed over the pictographic representations of the currentvehicle operational environment 23110/23120. For example, in someembodiments, the pictographic representations of the current vehicleoperational environment 23110/23120 may be presented and the verbaldescription 23130 of the vehicle operation assistance information may bepresented superimposed over the pictographic representations of thecurrent vehicle operational environment 23110/23120 after a short delay,such as one or two seconds.

FIG. 24 shows another example of a graphical representations of vehicleoperation assistance information for autonomous vehicle control lanechange in accordance with this disclosure. The representation shown inFIG. 24 may be similar to the representation shown in FIG. 23, except asdescribed herein. The example shown in FIG. 23 is an example of agraphical representations of vehicle operation assistance informationfor autonomous vehicle control lane change presented in response toidentifying the vehicle operation assistance information. The exampleshown in FIG. 24 shows an example of a graphical representations ofvehicle operation assistance information for autonomous vehicle controllane change that include elements presented in response to receivinginformation approving the autonomous vehicle control lane change, andelements presented in response to determining that the immanency ofvehicle operation assistance information for autonomous vehicle controllane change is within the minimum relevant immanence.

In some embodiments, the representation 24000 may include a firstportion 24100, a second portion 24200, or both. In some embodiments,generating the representation 24000 may include generating, oridentifying, one or more pictographic representations24110-24120/24210-21230 of the vehicle operation assistance informationgenerating or identifying one or more text representations 24130 of thevehicle operation assistance information, or a combination thereof. Insome embodiments, a pictographic representation of a current vehicleoperational environment may be a top-down, or bird's eye,representation, as shown at 24210.

For example, the vehicle operation assistance information may bepresented in response to receiving information approving the autonomousvehicle control lane change, which may indicate that the autonomousvehicle control lane change operation is an approved vehicle controloperation, and generating the representation of the vehicle operationassistance information may include generating the text representation24130, such as the text “OK to GO”, a pictographic representation of thecandidate vehicle control operation 24120, or a combination thereof, asshown for the first portion 24100. In some embodiments, the pictographicrepresentation of the candidate vehicle control operation 24120 mayinclude a visual indication that the autonomous vehicle control lanechange operation is an approved vehicle control operation, such as byusing a green color. In some embodiments, an auditory signal, such as achime, may be presented in response to receiving information approvingthe autonomous vehicle control lane change.

In some embodiments, the vehicle operation assistance information may bepresented in response to determining that the immanency of vehicleoperation assistance information for autonomous vehicle control lanechange is within the minimum relevant immanence. For example, theimmanency of vehicle operation assistance information for autonomousvehicle control lane change may be within the minimum relevant immanenceand the vehicle control lane change operation may be an unapprovedvehicle control operation, and generating the representation of thevehicle operation assistance information may include generating a textrepresentation (not shown), such as the text “Maneuver aborted”, apictographic representation of the unapproved candidate vehicle controloperation 24120, or a combination thereof, for the first portion 24100.In some embodiments, the pictographic representation of the candidatevehicle control operation 24120 may include a visual indication that theautonomous vehicle control lane change operation is an unapprovedvehicle control operation, such as by using a yellow color.

In another example, the immanency of vehicle operation assistanceinformation for autonomous vehicle control lane change may be within theminimum relevant immanence and the autonomous vehicle control lanechange operation may be an approved vehicle control operation, theautonomous vehicle control lane change operation may be performed, andgenerating the representation of the vehicle operation assistanceinformation may omit generating a text representation, and may includegenerating a pictographic representation of the approved candidatevehicle control operation 24120, for the first portion 24100. In someembodiments, the pictographic representation of the candidate vehiclecontrol operation 24120 may include a visual indication that theautonomous vehicle control lane change operation is an approved vehiclecontrol operation and is being performed, such as by using a green colorand oscillating, blinking, or flashing, the pictographic representationof the candidate vehicle control operation 24120.

In some embodiments, the second portion 24200 of the representation maybe similar to the second portion 23200 as shown in FIG. 23, except asdescribed herein. In some embodiments, the immanency of vehicleoperation assistance information for autonomous vehicle control lanechange may be within the minimum relevant immanence, the autonomousvehicle control lane change operation may be an approved vehicle controloperation, the autonomous vehicle control lane change operation may beperformed, and the second portion 24200 of the representation mayinclude a representation of the autonomous vehicle lane change operation24220, an indication of a result of the autonomous vehicle control lanechange operation 24230, as indicated by the vehicle drawn with brokenlines in FIG. 24, or a combination thereof. In some embodiments, theimmanency of vehicle operation assistance information for autonomousvehicle control lane change may exceed the minimum relevant immanence,or the autonomous vehicle control lane change operation may be anunapproved vehicle control operation, and the second portion 24200 ofthe representation may omit the representation of the autonomous vehiclelane change operation 24220 and the indication of the result of theautonomous vehicle control lane change operation 24230.

FIG. 25 shows an example of a graphical representations of vehicleoperation assistance information for an autonomous vehicle control turnoperation in accordance with this disclosure. For example, the vehiclemay traverse a portion of a vehicle transportation network in accordancewith a defined route from an origin to a destination; the route mayinclude a turn from a road to another road, and the vehicle operationassistance information may include an indication of the turn as acandidate vehicle control operation, as shown in FIG. 25.

In some embodiments, a representation 25000 of the vehicle operationassistance information may be generated, such as the generating shown at21400 in FIG. 21. In some embodiments, the representation 25000 mayinclude a first portion 25100, a second portion 25200, or both. In someembodiments, generating the representation 25000 may include generating,or identifying, one or more pictographic representations25110-25120/25210-25230 of the vehicle operation assistance information,generating or identifying one or more verbal descriptions 25130 of thevehicle operation assistance information, or a combination thereof.

In some embodiments, a pictographic representation25110-25120/25210-25230 of vehicle operation assistance information maybe identified, or generated, based on the vehicle operation assistanceinformation, the immanency, the urgency, whether a candidate vehiclecontrol operation is an approved vehicle control operation, or acombination thereof.

For example, the vehicle operation assistance information may indicate acandidate vehicle control operation identified based on a defined route,such as a route from an origin to a destination being traversed by thevehicle, an immanency may be identified, an urgency may be identified,whether the candidate vehicle control operation is an approved vehiclecontrol operation may be identified, and generating a representation25000 of the vehicle operation assistance information may includeidentifying, or generating, pictographic representations25110-25120/25210-25230, which may include one or more pictographicrepresentations of a current vehicle operational environment25110/25210, a pictographic representation of the candidate vehiclecontrol operation 25120, a pictographic representation of the vehicle25220, a pictographic representation of a route, trajectory, or expectedpath for the vehicle 25230, or a combination thereof.

In some embodiments, a pictographic representations of a current vehicleoperational environment, such as a graphical representation of a portionof the vehicle transportation network spatially proximate to thevehicle, may be a perspective representation, as shown at 25110. In someembodiments, a pictographic representation of a current vehicleoperational environment may be map view representation, as shown at25210.

In some embodiments, a pictographic representation of a current vehicleoperational environment 25210 may include a pictographic representationof a current portion of the vehicle transportation network, apictographic representation of the vehicle 25220, and a pictographicrepresentation of a trajectory 25230 of the vehicle, or a combinationthereof.

In some embodiments, a verbal description 25130 of the vehicle operationassistance information may explain or confirm the meaning of thepictographic representation 25110-25120/25210-25230, which may includean explanation of the vehicle operation assistance information, anindication of an option to cancel a vehicle operation, a representationof the immanence, or a combination thereof. Although shown below some ofthe pictographic representations of the current vehicle operationalenvironment 25110/25120, the verbal description 25130 of the vehicleoperation assistance information may be presented above, to the side, orsuperimposed over the pictographic representations of the currentvehicle operational environment 25110/25120. For example, in someembodiments, the pictographic representations of the current vehicleoperational environment 25110/25120 may be presented and the verbaldescription 25130 of the vehicle operation assistance information may bepresented superimposed over the pictographic representations of thecurrent vehicle operational environment 25110/25120 after a short delay,such as one or two seconds.

In some embodiments, the verbal description 25130 may indicate adescription of a candidate vehicle control operation, and an indicationof the immanence, such as “Left turn in 25 ft” as shown. In someembodiments, the verbal description 25130 may include an indication ofan option to cancel the candidate vehicle control operation, such as“Turning in 3 ft (to cancel maneuver press button)”.

FIG. 26 shows an example of a graphical representations of vehicleoperation assistance information for an autonomous vehicle speed controloperation in accordance with this disclosure. In some embodiments, avehicle may traverse a portion of a vehicle transportation network, thevehicle may approach a traffic control device of the vehicletransportation network, the vehicle may receive, or otherwise identify,vehicle operation assistance information indicating a recommended speedprofile for controlling the vehicle to traverse the vehicletransportation network in accordance with expected permittedright-of-way signal information for the traffic control device, and thevehicle operation assistance information may include a representation ofthe expected permitted right-of-way signal information for the trafficcontrol device, a representation of a current speed of the vehicle, arepresentation of the immanence, or a combination thereof, as shown inFIG. 26.

In some embodiments, a representation 26000 of the vehicle operationassistance information may be generated, such as the generating shown at21400 in FIG. 21. In some embodiments, the representation 26000 mayinclude a first portion 26100, a second portion 26200, or both. In someembodiments, generating the representation 26000 may include generating,or identifying, one or more pictographic representations26110-26130/26210 of the vehicle operation assistance information,generating or identifying one or more verbal descriptions 26130 of thevehicle operation assistance information, or a combination thereof.

In some embodiments, a pictographic representation 26110-26130/26210 ofvehicle operation assistance information may be identified, orgenerated, based on the vehicle operation assistance information, theimmanency, the urgency, whether a candidate vehicle control operation isan approved vehicle control operation, expected permitted right-of-waysignal information, or a combination thereof.

For example, the vehicle operation assistance information may indicate arecommended speed profile for controlling the vehicle to traverse thevehicle transportation network in accordance with expected permittedright-of-way signal information for a traffic control device of thevehicle transportation network, an immanency may be identified, anurgency may be identified, whether the candidate vehicle controloperation is an approved vehicle control operation may be identified,and generating a representation 26000 of the vehicle operationassistance information may include identifying, or generating,pictographic representations 26110-26130/26210, which may include one ormore pictographic representations of a current vehicle operationalenvironment 26110/26210, a pictographic representation of the a currenttrajectory of the vehicle 26120, a pictographic representation of theexpected permitted right-of-way signal information for a traffic controldevice 26130, or a combination thereof.

In some embodiments, a pictographic representations of a current vehicleoperational environment, such as a graphical representation of a portionof the vehicle transportation network spatially proximate to thevehicle, may be a perspective representation, as shown at 26110. In someembodiments, a pictographic representation of a current vehicleoperational environment may be map view representation, as shown at26210. In some embodiments, a pictographic representation of a currentvehicle operational environment may be a top-down, or bird's eye,representation, as shown at 24210.

In some embodiments, a pictographic representation of a current vehicleoperational environment 26110 may include a pictographic representationof a current portion of the vehicle transportation network, apictographic representation of a current trajectory of the vehicle26120, and a pictographic representation of the expected permittedright-of-way signal information for a traffic control device 26130, or acombination thereof. For example, the expected permitted right-of-waysignal information for a traffic control device 26130 may indicate thata traffic control light is currently display a green signal indicating apermitted right-of-way. Although not shown expressly in FIG. 26, in someembodiments, the right-of-way signal information for the traffic controldevice may indicate a cautionary permitted right-of-way signal, such asa yellow light, and the pictographic representation of the right-of-waysignal information for the traffic control device 26130 may indicate thecautionary permitted right-of-way signal status.

Although not shown expressly in FIG. 26, in some embodiments, thevehicle may be stopped at a denied right-of-way signal, such as a redlight, and the pictographic representation of the right-of-way signalinformation for the traffic control device 26130 may indicate the deniedright-of-way status.

In some embodiments, a text representation 26140/26150 of the vehicleoperation assistance information may include a representation of theimmanence 26140, a representation of a current speed of the vehicle26150, or both. For example, the representation of the immanence 26140may indicate an expected duration for the signal, such as a period oftime before a permitted right-of-way signal transitions to a deniedright-of-way signal, or a period of time before a denied right-of-waysignal transitions to a permitted right-of-way signal, such as “45 sec”as shown, or, in another example, “Green in 5 sec” (not shown).

In some embodiments, the immanency may be within the minimum relevantimmanence, which may indicate that the vehicle has traversed the portionof the vehicle transportation network corresponding to the trafficcontrol device under autonomous vehicle control, and a verbaldescription of the vehicle operation assistance information (not shown),which may indicate a vehicle operation control transfer from autonomousvehicle control to driver control, may be presented.

As used herein, the terminology “computer” or “computing device”includes any unit, or combination of units, capable of performing anymethod, or any portion or portions thereof, disclosed herein.

As used herein, the terminology “processor” indicates one or moreprocessors, such as one or more special purpose processors, one or moredigital signal processors, one or more microprocessors, one or morecontrollers, one or more microcontrollers, one or more applicationprocessors, one or more Application Specific Integrated Circuits, one ormore Application Specific Standard Products; one or more FieldProgrammable Gate Arrays, any other type or combination of integratedcircuits, one or more state machines, or any combination thereof.

As used herein, the terminology “memory” indicates any computer-usableor computer-readable medium or device that can tangibly contain, store,communicate, or transport any signal or information that may be used byor in connection with any processor. For example, a memory may be one ormore read only memories (ROM), one or more random access memories (RAM),one or more registers, low power double data rate (LPDDR) memories, oneor more cache memories, one or more semiconductor memory devices, one ormore magnetic media, one or more optical media, one or moremagneto-optical media, or any combination thereof.

As used herein, the terminology “instructions” may include directions orexpressions for performing any method, or any portion or portionsthereof, disclosed herein, and may be realized in hardware, software, orany combination thereof. For example, instructions may be implemented asinformation, such as a computer program, stored in memory that may beexecuted by a processor to perform any of the respective methods,algorithms, aspects, or combinations thereof, as described herein. Insome embodiments, instructions, or a portion thereof, may be implementedas a special purpose processor, or circuitry, that may includespecialized hardware for carrying out any of the methods, algorithms,aspects, or combinations thereof, as described herein. In someimplementations, portions of the instructions may be distributed acrossmultiple processors on a single device, on multiple devices, which maycommunicate directly or across a network such as a local area network, awide area network, the Internet, or a combination thereof.

As used herein, the terminology “example”, “exemplary”, “embodiment”,“implementation”, “aspect”, “feature”, or “element” indicate serving asan example, instance, or illustration. For the avoidance of doubt, thesubject matter disclosed herein is not limited by such examples. Unlessexpressly indicated, any example, embodiment, implementation, aspect,feature, or element is independent of each other example, embodiment,implementation, aspect, feature, or element and may be used incombination with any other example, embodiment, implementation, aspect,feature, or element. In addition, the examples, embodiments,implementations, aspects, features, and elements described herein assuch are not necessarily preferred or advantageous over other examples,embodiments, implementations, aspects, features, and elements, and theexamples, embodiments, implementations, aspects, features, and elementsdescribed herein do not preclude equivalent structures and techniquesknown to those of ordinary skill in the art. Furthermore, to the extentthat the terms “includes,” “has,” “contains,” and other similar wordsare used in either the detailed description or the claims, such termsare intended to be inclusive—in a manner similar to the term“comprising” as an open transition word—without precluding otherelements.

As used herein, the terminology “determine” and “identify”, or anyvariations thereof, includes selecting, ascertaining, computing, lookingup, receiving, determining, establishing, obtaining, or otherwiseidentifying or determining in any manner whatsoever using one or more ofthe devices shown and described herein.

As used herein, the terminology “or” is intended to mean an inclusive“or” rather than an exclusive “or”. That is, unless specified otherwise,or clear from context, “X includes A or B” is intended to indicate anyof the natural inclusive permutations. That is, if X includes A; Xincludes B; or X includes both A and B, then “X includes A or B” issatisfied under any of the foregoing instances. In addition, thearticles “a” and “an” as used in this application and the appendedclaims should generally be construed to mean “one or more” unlessspecified otherwise or clear from context to be directed to a singularform.

Further, for simplicity of explanation, although the figures anddescriptions herein may include sequences or series of steps or stages,elements of the methods disclosed herein may occur in various orders orconcurrently. Additionally, elements of the methods disclosed herein mayoccur with other elements not explicitly presented and described herein.Furthermore, not all elements of the methods described herein may berequired to implement a method in accordance with this disclosure.Although aspects, features, and elements are described herein inparticular combinations, each aspect, feature, or element may be usedindependently or in various combinations with or without other aspects,features, and elements.

The above-described aspects, embodiments, examples, and implementationshave been described in order to allow easy understanding of thedisclosure are not limiting. On the contrary, the disclosure coversvarious modifications and equivalent arrangements included within thescope of the appended claims, which scope is to be accorded the broadestinterpretation so as to encompass all such modifications and equivalentstructure as is permitted under the law.

What is claimed is:
 1. A vehicle configured to traverse a portion of avehicle transportation network, the vehicle comprising: a primarygraphical display portion; a secondary graphical display portion; and aprocessor configured to execute instructions stored on a non-transitorycomputer readable medium to: identify a vehicle operation assistanceinformation item, the vehicle operation assistance information itemindicating a location of a candidate vehicle control operation, on acondition that an immanency for the vehicle operation assistanceinformation item exceeds a maximum relevant immanence, store informationrepresenting the vehicle operation assistance information item, and on acondition that the immanency is within the maximum relevant immanence:present a representation of the vehicle operation assistance informationitem, wherein presenting the representation of the vehicle operationassistance information item includes: controlling the primary graphicaldisplay portion to present a graphical representation of the vehicleoperation assistance information item, wherein controlling the primarygraphical display portion to present the graphical representationincludes controlling the primary graphical display portion to present afirst portion of the graphical representation, and controlling thesecondary graphical display portion to present the graphicalrepresentation, wherein controlling the secondary graphical displayportion to present the graphical representation includes controlling thesecondary graphical display portion to present a second portion of thegraphical representation.
 2. The vehicle of claim 1, further comprising:a first graphical display unit, wherein the first graphical display unitincludes the first graphical display portion; and a second graphicaldisplay unit, wherein the second graphical display unit includes thesecond graphical display portion, and wherein the second graphicaldisplay unit is physically independent of the first graphical displayunit.
 3. The vehicle of claim 1, wherein the primary graphical displayportion is spatially located within the vehicle along a first angularoffset from a center of a primary field of view of the driver of thevehicle, and wherein the secondary graphical display portion isspatially located within the vehicle along a second angular offset fromthe center of the primary field of view of the driver of the vehicle,wherein the second angular offset is greater than the first angularoffset, such that the primary graphical display portion is visuallydistinct from the secondary graphical display portion.
 4. The vehicle ofclaim 1, wherein the candidate vehicle control operation is anautonomous vehicle control operation.
 5. The vehicle of claim 4,wherein: the candidate vehicle control operation is a lane changevehicle control operation; on a condition that the immanency exceeds aminimum relevant immanence: on a condition that the candidate vehiclecontrol operation is an unapproved vehicle control operation,controlling the primary graphical display portion to present the firstportion of the graphical representation includes controlling the primarygraphical display portion to present: a graphical representation of acandidate lane change vehicle control operation; a verbal request fordriver confirmation; and a verbal representation of the immanency, andon a condition that the candidate vehicle control operation is anapproved vehicle control operation, controlling the primary graphicaldisplay portion to present the first portion of the graphicalrepresentation includes controlling the primary graphical displayportion to present: a graphical representation of an expected lanechange vehicle control operation; and a verbal indication that thecandidate vehicle control operation is approved; and on a condition thatthe immanency is within the minimum relevant immanence: on a conditionthat the candidate vehicle control operation is an unapproved vehiclecontrol operation: controlling the primary graphical display portion topresent the first portion of the graphical representation includescontrolling the primary graphical display portion to present: agraphical representation of an aborted lane change vehicle controloperation, and a verbal indication of the aborted lane change vehiclecontrol operation; and the processor is configured to executeinstructions stored on the non-transitory computer readable medium tocontrol the vehicle to traverse the vehicle transportation network,wherein controlling the vehicle to traverse the vehicle transportationnetwork includes omitting the lane change vehicle control operation, andon a condition that the candidate vehicle control operation is anapproved vehicle control operation: controlling the primary graphicaldisplay portion to present the first portion of the graphicalrepresentation includes controlling the primary graphical displayportion to present a graphical representation of a current lane changevehicle control operation; and the processor is configured to executeinstructions stored on the non-transitory computer readable medium tocontrol the vehicle to traverse the vehicle transportation network inaccordance with the lane change vehicle control operation.
 6. Thevehicle of claim 5, wherein the processor is configured to executeinstructions stored on the non-transitory computer readable medium todetermine that the candidate vehicle control operation is an approvedvehicle control operation in response to receiving driver inputindicating that the candidate vehicle control operation is an approvedvehicle control operation.
 7. The vehicle of claim 4, wherein theprocessor is configured to execute instructions stored on thenon-transitory computer readable medium to: identify a route for thevehicle to traverse the vehicle transportation network from an origin toa destination, wherein the route includes a current geospatial locationof the vehicle, the candidate vehicle control operation, and a targetgeospatial location in the vehicle transportation network correspondingto the candidate vehicle control operation; on a condition that theimmanency exceeds a minimum relevant immanence: on a condition that thecandidate vehicle control operation is an approved vehicle controloperation, control the primary graphical display portion to present thefirst portion of the graphical representation by controlling the primarygraphical display portion to present: a graphical representation of anexpected vehicle control operation corresponding to the candidatevehicle control operation; a verbal request for driver confirmation; anda verbal representation of the immanency; and on a condition that theimmanency is within the minimum relevant immanence: on a condition thatthe candidate vehicle control operation is an approved vehicle controloperation: control the primary graphical display portion to present thefirst portion of the graphical representation by controlling the primarygraphical display portion to present a graphical representation of avehicle control operation corresponding to the candidate vehicle controloperation; and control the vehicle to traverse the vehicletransportation network in accordance with the candidate vehicle controloperation.
 8. The vehicle of claim 7, wherein the processor isconfigured to execute instructions stored on the non-transitory computerreadable medium to determine that the candidate vehicle controloperation is an unapproved vehicle control operation in response toreceiving driver input indicating that the candidate vehicle controloperation is an unapproved vehicle control operation.
 9. The vehicle ofclaim 4, wherein the processor is configured to execute instructionsstored on a non-transitory computer readable medium to: identify thevehicle operation assistance information item in response to receivinginformation indicating a recommended speed profile for controlling thevehicle to traverse the vehicle transportation network in accordancewith expected permitted right-of-way signal information for a trafficcontrol device of the vehicle transportation network, wherein anexpected path for the vehicle includes a portion of the vehicletransportation network corresponding to the traffic control device; on acondition that the immanency exceeds a minimum relevant immanence, andon a condition that the candidate vehicle control operation is anapproved vehicle control operation, control the primary graphicaldisplay portion to present the first portion of the graphicalrepresentation by controlling the primary graphical display portion topresent: a verbal representation of a current speed of the vehicle, anda verbal representation of the immanency; and on a condition that theimmanency is within the minimum relevant immanence, and on a conditionthat the candidate vehicle control operation is an approved vehiclecontrol operation: control the primary graphical display portion topresent the first portion of the graphical representation by controllingthe primary graphical display portion to present: the verbalrepresentation of the current speed of the vehicle; and the verbalrepresentation of the immanency, and control the vehicle to traverse thevehicle transportation network in accordance with the candidate vehiclecontrol operation by adjusting a speed of the vehicle in response to theexpected traffic control device state information.
 10. The vehicle ofclaim 9, wherein the processor is configured to execute instructionsstored on the non-transitory computer readable medium to determine thatthe candidate vehicle control operation is an approved vehicle controloperation in response to receiving driver input indicating that thecandidate vehicle control operation is an approved vehicle controloperation.
 11. The vehicle of claim 4, wherein the processor isconfigured to execute instructions stored on a non-transitory computerreadable medium to: identify the vehicle operation assistanceinformation item in response to receiving a vehicle operation controltransfer request that includes a driver initiated vehicle operationparking assistance request; and control the primary graphical displayportion to present the first portion of the graphical representation bycontrolling the primary graphical display portion to present a verbalrepresentation of a vehicle operation corresponding to the driverinitiated vehicle operation parking assistance request.
 12. The vehicleof claim 1, wherein the processor is configured to execute instructionsstored on a non-transitory computer readable medium to control thesecondary graphical display portion to present the second portion of thegraphical representation by controlling the secondary graphical displayportion to present a graphical representation of a current vehicleoperational environment status.
 13. The vehicle of claim 12, wherein, ona condition that the immanency is within the minimum relevant immanence,and on a condition that the candidate vehicle control operation is anapproved vehicle control operation, controlling the secondary graphicaldisplay portion to present the graphical representation of the currentvehicle operational environment status includes controlling thesecondary graphical display portion to present a graphicalrepresentation of an expected vehicle control operation corresponding tothe candidate vehicle control operation.
 14. The vehicle of claim 12,wherein, controlling the secondary graphical display portion to presentthe graphical representation of the current vehicle operationalenvironment status includes: identifying a route for the vehicle totraverse the vehicle transportation network from an origin to adestination, wherein the route includes a current geospatial location ofthe vehicle; and controlling the secondary graphical display portion topresent a graphical representation of a portion of the vehicletransportation network spatially proximate to the vehicle, the graphicalrepresentation including a graphical representation of the vehicle and agraphical representation of the route.
 15. The vehicle of claim 12,wherein controlling the secondary graphical display portion to presentthe graphical representation of the current vehicle operationalenvironment status includes controlling the secondary graphical displayportion to present a graphical representation of the vehicle and agraphical representation of a current operational environment of thevehicle, wherein the graphical representation of the current operationalenvironment of the vehicle includes: a graphical representation of aportion of the vehicle transportation network spatially proximate to thevehicle; and a graphical representation of expected spatial availabilityproximate to the vehicle.
 16. The vehicle of claim 15, wherein, on acondition that the vehicle operation assistance information itemindicates a driver initiated vehicle operation parking assistancerequest, controlling the secondary graphical display portion to presentthe graphical representation of the current vehicle operationalenvironment status includes controlling the secondary graphical displayportion to present a graphical representation of a parking spotidentified in response to the driver initiated vehicle operation parkingassistance request.
 17. The vehicle of claim 15, wherein controlling thesecondary graphical display portion to present the graphicalrepresentation of expected spatial availability proximate to the vehicleincludes: identifying a spatial area proximate to the vehicle;determining a probability that the spatial area is available fortraversal by the vehicle; and controlling the secondary graphicaldisplay portion to present a graphical representation of the spatialarea based on the probability.
 18. The vehicle of claim 17, whereindetermining the probability includes: identifying a first probability asthe probability, wherein the first probability is high; in response toidentifying an object within the spatial area, identifying a secondprobability as the probability, wherein the second probability is low;and in response to identifying an object spatially proximate to thespatial area, and in response to identifying an intersection between anexpected path for the object and the spatial area, and on a conditionthat a temporal location corresponding to the intersection is within athreshold, identifying a second probability as the probability, whereinthe third probability is less than the first probability and is greaterthan the second probability.
 19. The vehicle of claim 18, wherein theobject is a remote vehicle or a pedestrian.
 20. The vehicle of claim 1,further comprising: an auditory presentation device, wherein: on acondition that the candidate vehicle control operation is a lane changevehicle control operation: in response to identifying the vehicleoperation assistance information item, the processor is configured toexecute instructions stored on the non-transitory computer readablemedium to control the auditory presentation device to present anauditory representation of the vehicle operation assistance informationitem; and in response to determining that the candidate vehicle controloperation is an approved vehicle control operation, the processor isconfigured to execute instructions stored on the non-transitory computerreadable medium to control the auditory presentation device to presentthe auditory representation of the vehicle operation assistanceinformation item, and in response to receiving information indicating arecommended speed profile for controlling the vehicle to traverse thevehicle transportation network in accordance with expected permittedright-of-way signal information for a traffic control device of thevehicle transportation network, wherein an expected path for the vehicleincludes a portion of the vehicle transportation network correspondingto the traffic control device, and on a condition that the immanency iswithin a minimum relevant immanence, and on a condition that thecandidate vehicle control operation is an approved vehicle controloperation, the processor is configured to execute instructions stored onthe non-transitory computer readable medium to control the auditorypresentation device to present the auditory representation of thevehicle operation assistance information item.
 21. A vehicle configuredto traverse a portion of a vehicle transportation network, the vehiclecomprising: a primary graphical display portion; a secondary graphicaldisplay portion; and a processor configured to execute instructionsstored on a non-transitory computer readable medium to: identify avehicle operation assistance information item, the vehicle operationassistance information item indicating a location of a candidate vehiclecontrol operation, and present a representation of the vehicle operationassistance information item, wherein presenting the representation ofthe vehicle operation assistance information item includes: controllingthe primary graphical display portion to present a graphicalrepresentation of the vehicle operation assistance information item,wherein controlling the primary graphical display portion to present thegraphical representation includes controlling the primary graphicaldisplay portion to present a first portion of the graphicalrepresentation; and controlling the secondary graphical display portionto present the graphical representation, wherein controlling thesecondary graphical display portion to present the graphicalrepresentation includes controlling the secondary graphical displayportion to present a second portion of the graphical representation,determine whether the candidate vehicle control operation is an approvedvehicle control operation, in response to a determination that thecandidate vehicle control operation is an unapproved vehicle controloperation: identify a secondary vehicle control action; and control thevehicle to traverse the vehicle transportation network in accordancewith the secondary vehicle control action, wherein controlling thevehicle to traverse the vehicle transportation network in accordancewith the secondary vehicle control action includes omitting thecandidate vehicle control operation, and in response to a determinationthat the candidate vehicle control operation is an approved vehiclecontrol operation, control the vehicle to traverse the vehicletransportation network in accordance with the candidate vehicle controloperation.
 22. An autonomous vehicle configured to traverse a portion ofa vehicle transportation network, the vehicle comprising: a primarygraphical display portion; a secondary graphical display portion; atrajectory controller; and a processor configured to executeinstructions stored on a non-transitory computer readable medium to:identify a vehicle operation assistance information item, the vehicleoperation assistance information item indicating a location of acandidate vehicle control operation, present a representation of thevehicle operation assistance information item, wherein presenting therepresentation of the vehicle operation assistance information itemincludes, controlling the primary graphical display portion to present agraphical representation of the vehicle operation assistance informationitem, and controlling the secondary graphical display portion to presentthe graphical representation, determine whether the candidate vehiclecontrol operation is an approved vehicle control operation, in responseto a determination that the candidate vehicle control operation is anapproved vehicle control operation, identify the candidate vehiclecontrol action as a vehicle control action, in response to adetermination that the candidate vehicle control operation is anunapproved vehicle control operation, identify a secondary vehiclecontrol action as the vehicle control action, and control the trajectorycontroller to operate the vehicle to autonomously traverse the vehicletransportation network in accordance with the vehicle control action.